The source code is not the LLM. The LLM is billioms of random floating point numbers that somehow encode everything the model knows and can do.
The ML field has a good understanding of the algorithms that produce these floating point numbers and lots of techniques that seem to produce “better” numbers in experiments. However, there is little to no understanding of what the numbers represent or how they do the things they do.