foundation model contains generic human behaviours

Table of Contents

as foundation model are pre-trained on large amount of human behaviours (language, language-visual association, etc.), it contains a comprehensive model of generic human behaviours.

when used in specific task, this model of generic human behaviours could help, if the task would largely comply to, or understandable with generic human behaviours, which is trained, with lots of design works and computation resources, into the foundation model.

Backlinks

human language simulation layer

_20240201_0132116c5db6e03ae551db.png

it can be observed, that there is a layer of human cognition, or at least a set of primitives in a very closely coupled context, that is simulating what would be in the language, rather than processing ideas/concepts.

It is sometimes refereed to as “go on autopilot”

e.g.: when in a discussion with a friend, you may go on “autopilot” and just saying things that would be common in such discussions like “totally”, “I say”, “Aye Aye”, “sure”

This particular layer could be simulated by LLM’s or be the generic human behaviours foundation model contains

https://tech.lgbt/@agatha/111851564373692787

highlight + comment method is slow

(expectation)

  • this may be due to density of novel ideas, which require more typing work in zettelkasten, as well as setting up basic nodes such as foundation model to talk about it in foundation model contains generic human behaviours.
  • when density of novel ideas in a text is lower for familiarity of the topic or just nature of text, (current test are done with introduction, where bird eye’s view of lots of ideas are mentioned), the time is expected to lower.
  • yet still, this method is going to be slower and suitable for close read.

As foundation model contains generic human behaviour, when the task complys to generic human behaviours, it can be done instantly, as it were performed by a unskilled mediocre human who knows a lot of information

as foundatoin model usually works with an extensible notion of class, zero-shot learning is almost imperative.

Author: Linfeng He

Created: 2024-04-03 Wed 23:14