Firoozi, Roya ::: Foundation Models in Robotics: Applications, Challenges, and the Future

Table of Contents

1. List of authors

It’s very long. I only kept the first one.

2. Content   ATTACH

_20240126_203410screenshot.png

suryve of application of foundation models in robotics:

  • perception
  • decision-making
  • control

with highlights in:

  • common sense reasoning
  • vision-language models
  • open-vocabulary visual recognition

with challenges in:

  • scarcity of robot-relevent training dat
  • safety guarantees
  • uncertainty quantification
  • real-time execution

with external sources:

3. Notes

4. Comments

4.1. first sight

  • This review is very long. 33 pages.
  • This review looks neat, with dependency explained and a clear mission of work: usage of foundation model(pretrained large model) in robotics
    • lines of works are listed with their keywords and brief intro. work could be done just following those leads and establish those lines of works/ideas, and have a nice flesh of ideas in the field
    • evaluation: usage, pro anc cons of techniques, what are the scope, what are typical applications, what are properties, and examples. with one bencharmark; with baseline method, what is changed;input and output, what is mapped to what, information flow, computation compacity, speed
    • graphs: lots of graphs, make lots of graphs. This may be an oppurtunity to understnnd how latex graphs work.
  • 10 graphs and formula and 9 are in the first 1/3
    • background - almost all graphs and formula are in background
  • mostly 2022, 2023, oldests are 2014(1), 2015, 2016 could be in rush, field work density, or scope of choise.

Author: Linfeng He

Created: 2024-04-03 Wed 19:37