Compute-Optimal Model Size
~10 mincode completion
Implement compute_optimal(C, tokens_per_param) returning the array [N, D].
Where this shows up
~10 min
••••••••••••••••
8 employers weight this skill
2 health and bio companies, 2 quant funds, 2 enterprise vendors, 1 AI product company, 1 frontier lab. Top match scores 87.
Python
import numpy as np
def compute_optimal(C, tokens_per_param):
"""
Compute-optimal parameter and token counts for a training budget.
Args:
C: compute budget in FLOPs
tokens_per_param: fixed ratio r = D / N (about 20 for Chinchilla)
Returns:
array [N, D]
"""
# YOUR CODE HERE
pass