Mathematical Activation Functions

Mathematical Activation Functions currently known, and new ones that are becoming commonly used. This page may change on a reasonably regular basis, due to changes in the industry.

Created: 11/12/2024 2:23:31 PM

Attention is all you need

Attention is all you need, this paper, written way back on 12 Jun 2017, now up to its v7th inception, is a concept that has changed AI Models, in particular the Transformer Models more than any other concept written about.

Created: 3/12/2025 4:25:27 PM

The Transformer AI Model

The Transformer AI Model is a very popular model for LLM's today! LLM's, Large Language Models are one of the most common models in the Artificial Intelligence industry today.

Created: 3/13/2025 7:57:15 AM