Get Started
Installation Guide
Clone the repository and install the necessary dependencies:
Python 3.11 Required or Higher
Using Modal (Optional)
If you plan to run distillation jobs on Modal, you’ll need to set up your Modal API token.
Using Docker (Optional)
For a containerized setup, a Dockerfile
is provided.
You can build the Docker image using:
Then, you can run the container. By default, it runs the scripts/local/distill_logits.py
script with the default configuration.