![[AI learning.opus]]

Info Compression fallacy

I heard Nir Eyal talking about how a long novel can be easily compressed into a short movie coz novel explains the scenery and movie can just show it in a clip very quick.
here

The Analysis

• If something is compressed, then first of all there are chances of missing some data in compression, unless the compaction is very smart and lossless.
• If something is compressed, then the decompression should be smart and lossless too!
• If the content is light and strategically compressed, then even lossy compression and decompression is fine. For eg, a good movie maker can choose to be lossless in compression and add all the minor details or choose to skip few irrelevant bits. And an avid viewer can decompress the tiniest details and be happy about the lossless compression or critique the lossy compression. A viewer can also choose to do a lossy decompression and only get major data that they were able to decipher and chose to be content with it or feel lost.
• Compression relies on richness of source. Movies can be derived from novel or scripts made specifically for the movie.
  • Novel or script is basically compression of the writer's thought.
    • Their thoughts are basically compression of truth or experiences which can be lossy based on weak raw material knowledge and biases and experiences they have.
• So even before the viewer decompresses the movie, some director would be decompressing the script or novel which was already decompressed by writer . So a series of potential lossy chains
• Think about how inception and interstellar were aimed to be lossless compression but failed at decompression or other movies that lacked details or were weak compression of original source)

Conclusion

As a consumer, consuming compressed knowledge is a risk.
But in all of the above discussion, there were humans involved who can put in efforts to fix lossyness, coz they have repercussions of bad review or distrust or just intent to be perfectionists.

AI is not incentivised to be lossless. And it is a black box which has a habit of haalucination. Hallucination has been curbed right now, but that is suppression and guardrails of obvious stuff by adding strict judges, the hallucianation at this point has been curbed to be unidentifiable, but it still can be there!

So AI content is even more riskier than human generated content.