Clone the repository and install the necessary dependencies:
git clone https://github.com/agokrani/distillKitPlus.git
cd distillKitPlus
# (Optional but recommended) Create and activate a virtual environment
python3.11 -m venv venv
source venv/bin/activate # On Windows use `venv\Scripts\activate`
pip install -r requirements.txt
pip install -e .
Python 3.11 Required or Higher
Using Modal (Optional)
If you plan to run distillation jobs on Modal, you’ll need to set up your Modal API token.
Using Docker (Optional)
For a containerized setup, a Dockerfile
is provided.
You can build the Docker image using:
docker build -t distillkitplus .
Then, you can run the container. By default, it runs the scripts/local/distill_logits.py
script with the default configuration.
docker run -it --rm --gpus all distillkitplus