Code

add SMS-WSJ RETURNN datasets#116

Code

Open

vieting wants to merge 47 commits intomainrwth-i6/i6_experiments:mainfrom peter_sms_wsjrwth-i6/i6_experiments:peter_sms_wsjCopy head branch name to clipboard

Commits

Commits on Feb 2, 2023

• add SMS-WSJ RETURNN datasets

  vieting

  committed
  59edbeb

  Copy full SHA for 59edbeb

• black formatting

  vieting

  committed
  d95f335

  Copy full SHA for d95f335

• remove hard coded label for padding

  vieting

  committed
  2da7e59

  Copy full SHA for 2da7e59

• add SmsWsjMixtureEarlyBpeDataset

  vieting

  committed
  7bfa8d4

  Copy full SHA for 7bfa8d4

• black formatting

  vieting

  committed
  8c539ea

  Copy full SHA for 8c539ea

Commits on Feb 3, 2023

• fix data_types

  vieting

  committed
  9ad34aa

  Copy full SHA for 9ad34aa

Commits on Feb 6, 2023

• bpe add data types

  vieting

  committed
  ac0718c

  Copy full SHA for ac0718c

• allow original alignment

  vieting

  committed
  5c0ea9e

  Copy full SHA for 5c0ea9e

• black

  vieting

  committed
  ff2f0ea

  Copy full SHA for ff2f0ea

Commits on Feb 7, 2023

• Update common/datasets/sms_wsj/returnn_datasets.py

  vieting

  authored
  44774a8

  Copy full SHA for 44774a8

• Update common/datasets/sms_wsj/returnn_datasets.py

  Show description for eed5171
  

  vieting

  and

  SimBe195

  authored
  eed5171

  Copy full SHA for eed5171

• Update common/datasets/sms_wsj/returnn_datasets.py

  Show description for 1db9771
  

  vieting

  and

  SimBe195

  authored
  1db9771

  Copy full SHA for 1db9771

• Update common/datasets/sms_wsj/returnn_datasets.py

  Show description for 10a13cf
  

  vieting

  and

  SimBe195

  authored
  10a13cf

  Copy full SHA for 10a13cf

• Update common/datasets/sms_wsj/returnn_datasets.py

  Show description for f7ef64a
  

  vieting

  and

  SimBe195

  authored
  f7ef64a

  Copy full SHA for f7ef64a

• Update common/datasets/sms_wsj/returnn_datasets.py

  Show description for 0f4d363
  

  vieting

  and

  SimBe195

  authored
  0f4d363

  Copy full SHA for 0f4d363

• Update common/datasets/sms_wsj/returnn_datasets.py

  Show description for c64c6fc
  

  vieting

  and

  SimBe195

  authored
  c64c6fc

  Copy full SHA for c64c6fc

• review comments

  vieting

  committed
  f39ebda

  Copy full SHA for f39ebda

• black

  vieting

  committed
  8b7ad02

  Copy full SHA for 8b7ad02

Commits on Feb 9, 2023

• _segment_to_rasr str input

  vieting

  committed
  f736a50

  Copy full SHA for f736a50

• sms wsj add init

  vieting

  committed
  4445b29

  Copy full SHA for 4445b29

• caching: use local files if available

  vieting

  committed
  19d033e

  Copy full SHA for 19d033e

• non standard imports inside classes

  vieting

  committed
  ac70e9d

  Copy full SHA for ac70e9d

• black

  vieting

  committed
  30a90f7

  Copy full SHA for 30a90f7

• update of super() usage

  vieting

  committed
  dcce15a

  Copy full SHA for dcce15a

• simplify buffer logic

  vieting

  committed
  e80e210

  Copy full SHA for e80e210

• print to log

  vieting

  committed
  f0a0fd8

  Copy full SHA for f0a0fd8

• avoid name RASR

  vieting

  committed
  f2aac11

  Copy full SHA for f2aac11

• simons review comments

  vieting

  committed
  d55bd5a

  Copy full SHA for d55bd5a

Commits on Feb 10, 2023

• update caching logic

  vieting

  committed
  2f0c484

  Copy full SHA for 2f0c484

• returnn log

  vieting

  committed
  4074af4

  Copy full SHA for 4074af4

• pad start int

  vieting

  committed
  c188b82

  Copy full SHA for c188b82

• log unzipping command

  vieting

  committed
  439da8f

  Copy full SHA for 439da8f

• rename rasr variable

  vieting

  committed
  f58844a

  Copy full SHA for f58844a

• use sequence buffer class

  vieting

  committed
  caa18a3

  Copy full SHA for caa18a3

• black

  vieting

  committed
  55ff943

  Copy full SHA for 55ff943

Commits on Feb 13, 2023

• chmod -f

  vieting

  committed
  8ecf218

  Copy full SHA for 8ecf218

• chmod force exit 0

  vieting

  committed
  cab1c3c

  Copy full SHA for cab1c3c

• read data from zip instead of unzipping

  vieting

  committed
  15ebbdc

  Copy full SHA for 15ebbdc

• cleanup

  vieting

  committed
  b051045

  Copy full SHA for b051045

• black

  vieting

  committed
  3823e2b

  Copy full SHA for 3823e2b

Commits on Feb 14, 2023

• fix buffer logic

  vieting

  committed
  b8c3811

  Copy full SHA for b8c3811

• explicit num_outputs required

  vieting

  committed
  fca6ea3

  Copy full SHA for fca6ea3

• prefetch buffer size

  vieting

  committed
  45fb9a0

  Copy full SHA for 45fb9a0

• fix init seq order

  vieting

  committed
  c2cb0a0

  Copy full SHA for c2cb0a0

• allow shuffling

  vieting

  committed
  a7fc519

  Copy full SHA for a7fc519

Commits on Feb 15, 2023

• try reading from zip 5 times

  vieting

  committed
  ac50834

  Copy full SHA for ac50834

• black

  vieting

  committed
  48ad8b5

  Copy full SHA for 48ad8b5