[18.12.20] Music Transformer: Generating Music With Long-Term Structure

[jason9693]

Music Transformer: Generating Music With Long-Term Structure

• Accepted Conference Name & Year : ex) CVPR 2017
• 1st Author Name & Institute : Cheng-Zhi Anna Huang, Google Brain

Keywords

• Related Attention
• Space Complexity
• Memory.

Contribution

• Domain: 기존의 Seq2Seq 작곡모델의 제한된 길이의 메모리 문제를 해결.
• Algorithm: Transformer의 공간복잡도를 O(N^2D)에서 O(ND)로 단축.

Proposed Architecture

• Pre Processing

  • Multi Track
    
  • Single Track
    

• Model

Dataset

• SERIALIZED INSTRUMENT/TIME GRID (J.S.BACH CHORALES)
• MIDI-LIKE EVENT-BASED (PIANO-E-COMPETITION)

Valuable Relative Works