François Fleuret's git - mygpt.git/search

2022-08-08	Francois Fleuret	Added args.learning_rate_end for an exponential decay.	commit \| commitdiff \| tree
2022-08-08	Francois Fleuret	Added the small weight embedding + id layer norm inits.	commit \| commitdiff \| tree
2022-08-07	Francois Fleuret	Added the rng state in the checkpoint.	commit \| commitdiff \| tree
2022-08-07	Francois Fleuret	Added the small-weight embedding initialization.	commit \| commitdiff \| tree
2022-07-30	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-30	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-30	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-30	Francois Fleuret	Fixed a bug when there are no squares.	commit \| commitdiff \| tree
2022-07-29	Francois Fleuret	OCDC	commit \| commitdiff \| tree
2022-07-29	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-29	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-29	Francois Fleuret	OCDC	commit \| commitdiff \| tree
2022-07-29	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-28	Francois Fleuret	OCDC	commit \| commitdiff \| tree
2022-07-28	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-27	Francois Fleuret	Fixed stuff.	commit \| commitdiff \| tree
2022-07-27	Francois Fleuret	OCDC	commit \| commitdiff \| tree
2022-07-27	Francois Fleuret	OCDC	commit \| commitdiff \| tree
2022-07-27	Francois Fleuret	OCDC	commit \| commitdiff \| tree
2022-07-27	Francois Fleuret	Cleaning up more.	commit \| commitdiff \| tree
2022-07-27	Francois Fleuret	OCD cosmectics	commit \| commitdiff \| tree
2022-07-27	Francois Fleuret	Cosmetics.	commit \| commitdiff \| tree
2022-07-27	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-27	Francois Fleuret	OCD cosmetics.	commit \| commitdiff \| tree
2022-07-27	Francois Fleuret	Compute both the average number of requested and obtained...	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Fixed the size of w_o.	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Added a null token, which is the one to predict.	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Removed the Linear transformation since there is now...	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-26	Francois Fleuret	Moved the input/output shift in the forward of the...	commit \| commitdiff \| tree
2022-07-25	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-25	Francois Fleuret	OCD update	commit \| commitdiff \| tree
2022-07-25	Francois Fleuret	Added --no_checkpoint	commit \| commitdiff \| tree
2022-07-25	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-25	Francois Fleuret	Initialize properly w_o.	commit \| commitdiff \| tree
2022-07-25	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-25	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-25	Francois Fleuret	Added the (missing) W_o	commit \| commitdiff \| tree
2022-07-25	Francois Fleuret	Removed the default image size.	commit \| commitdiff \| tree
2022-07-16	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-16	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-16	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-16	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-16	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-16	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-15	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-15	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-15	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-02	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-01	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-07-01	Francois Fleuret	Add cross-attention to QKVAttention.	commit \| commitdiff \| tree
2022-06-20	Francois Fleuret	Finalized PicoCLVR with "many colors".	commit \| commitdiff \| tree
2022-06-17	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-06-17	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-06-17	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-06-13	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-06-10	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-05-12	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-05-11	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-29	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-29	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-29	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-26	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-26	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-26	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-25	Francois Fleuret	Fixed an asymmetry between top / bottom and between...	commit \| commitdiff \| tree
2022-04-25	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-24	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-24	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-24	Francois Fleuret	Update.	commit \| commitdiff \| tree
2022-04-24	Francois Fleuret	Initial commit	commit \| commitdiff \| tree

A minimal implementation of a GPT-like model.

RSS Atom