From: Francois Fleuret <francois@fleuret.org>
Date: Mon, 8 Aug 2022 05:13:54 +0000 (+0200)
Subject: Added the small weight embedding + id layer norm inits.
X-Git-Url: https://www.fleuret.org/cgi-bin/gitweb/gitweb.cgi?a=commitdiff_plain;h=3b62d298013c7b940aec7cab0f74fb5118493f99;hp=3b62d298013c7b940aec7cab0f74fb5118493f99;p=mygpt.git

Added the small weight embedding + id layer norm inits.
---