feedback connection

Table of Contents

feedback connection is taking last timestep’s output into this timestep’s input.

The most trivial way of doing it is to give that output some weight, and sum it together with all other inputs, hence _20240307_132944screenshot.png

Backlinks

recurrent neural network

_20240307_132654screenshot.png Recurent neural network is normal neural network, adding feedback connection.

  • with feedback connection, it can handle sequence, but also have problem of

Author: Linfeng He

Created: 2024-04-03 Wed 23:17