Python 3.11 Required or Higher
Using Modal (Optional)
If you plan to run distillation jobs on Modal, you’ll need to set up your Modal API token.Using Docker (Optional)
For a containerized setup, aDockerfile
is provided.
You can build the Docker image using:
scripts/local/distill_logits.py
script with the default configuration.