Installation Guide

Clone the repository and install the necessary dependencies:

git clone https://github.com/agokrani/distillKitPlus.git
cd distillKitPlus

# (Optional but recommended) Create and activate a virtual environment
python3.11 -m venv venv
source venv/bin/activate # On Windows use `venv\Scripts\activate`

pip install -r requirements.txt
pip install -e .  

Python 3.11 Required or Higher

Using Modal (Optional)

If you plan to run distillation jobs on Modal, you’ll need to set up your Modal API token.

Using Docker (Optional)

For a containerized setup, a Dockerfile is provided. You can build the Docker image using:

docker build -t distillkitplus .

Then, you can run the container. By default, it runs the scripts/local/distill_logits.py script with the default configuration.

docker run -it --rm --gpus all distillkitplus