grain ~master (2021-05-15T05:53:16Z)
Dub
Repo
Corpus.batchfy
grain
dataset
ptb
Corpus
returns word-id 2d slice shaped (seqlen, batchsize)
struct
Corpus
auto
batchfy
(
string
name
)
Meta
Source
See Implementation
grain
dataset
ptb
Corpus
functions
batchfy
register
vocabSize
variables
batchSize
dataset
dict
returns word-id 2d slice shaped (seqlen, batchsize)