Skip to content

kippsoftware/ai-transformer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ai-transformer

Software to support a course on how GPT works.

Files

corpus.py - convert JSON from the Cornell Movie Corpus into GPT input

tokenizer.py - encode and decode text using lowercase alphabet a-z

one_hot_encoding.py - explain one-hot encoding and how it is used

transformer.py - use tokenizer to generate output

bigram.py - holds a two-character probabilistic model

About

Software to support a course on how GPT works

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages