rgw@icdattcwsm:~/Blog$ cat 2024-12-04-Balance.md

The most challenging part of training AI models is figuring out how to 'integrate' a specific optimization with the rest of the system, in a manner that doesn't produce strange results.

An optimization that makes a model great in one area could cause it to be sub-optimal in another.

In other words, AI has hit a roadblock called 'life'.

The moment we optimize for exercise, we crave more junk food. So, we take years to figure out how to strike a balance.

The moment a child discovers an efficiency in being emotionally resonant, it would make puppy-dog eyes and learn to 'get away' with poor grades. So, parenting is also about imbuing balance.

A startup that optimizes for R&D in its early months will inevitably be sub-optimal in other areas like marketing and sales. So entrepreneurship is also about balance.

Perhaps, the true Turing test for AGI is the extent to which a system's evolution is impacted by this thing we call 'life'.

rgw@icdattcwsm:~/Blog$ cd ..