310 release candidate

[maziyarpanahi]

This PR introduces the following features:

• Updates existing loadSavedModel function to import TensorFlow SavedModel to be compatible with TF v2
• Updates existing read and write TF v1 graph (freeze) to be compatible with TF v2 (currently crashes for none existing targets in TF v2 graph)
• Implements ModelSignature to support different model providers such as TF Hub, HuggingFace, etc. (if they are for raw embedding with last_hidden_state or pooler_output) for SavedModel in TF v2 (currently only supports TF v1 with hard-coded placeholders for inputs and outputs)

Annotators adapted to these changes to support TF v2 SavedModel:

• BertEmbeddings
• BertSentenceEmbeddings
• DistilBertEmbeddings
• RoBertaEmbeddings
• XlmRoBertaEmbeddings

NOTE: All the previous models exported from TF v1 or uploaded as pretrained are still compatible. This PR will extend the support to TF v2 SavedModel especially the use of loadSavedModel in Python/Scala to easily import models from TF Hub and HuggingFace for the listed annotators.

NOTE2: There are other branches using TF v2 models which rely on this branch. (it was the only way to have support for TF v2 SavedModel for development)

########
This PR introduces a new annotator for RoBertaEmbeddings based on RoBERTa models (for instance roberta-base).

Import the following models:

• roberta-base
• roberta-large
• distilroberta-base

########
This PR introduces a new annotator for DistilBertEmbeddings based on DistilBERT models (for instance distilbert-base-cased).

Benchmarks against bert_base_cased have shown better speed and very close accuracy in NER (faster convergence).

Import the following models:

• distilbert-base-cased
• distilbert-base-uncased
• distilbert-base-multilingual-cased

########

• In this PR MarianTransformer will only support models exported in TensorFlow v2 architecture with the support of ModelSignatureConstants. This change helps to take advantage of new optimizations in TensorFlow 2.x and also made the process of exporting and maintaining the code easier for the team

• Some improvements were done in ModelSignatureConstants to preserve saveDef required values in signature for saving/restoring of TF v2 models.

WARNING: Due to this change, the previous models (online/offline) will not work. Around 640+ models/pipelines must be exported and uploaded again for the upcoming Spark NLP 3.1.0 release.

########

Other PRs

• BPE, input IndexToken, Output Array[TokenPiece] #2867 first implementation of BPE tokenizer for roBERTa, GPT2, and XLM
• Introducing DistilBertEmbeddings annotator based on DistilBERT models  #2871 DistilBertEmbeddings annotator
• Introducing RoBertaEmbeddings annotator based on RoBERTa models #2902 RoBertaEmbeddings annotator
• Added fix for ending zero index in single char initial token in positional mask algorithm #2874
• Introducing new XlmRoBertaEmbeddings annotator #2947 XlmRoBertaEmbeddings
• Migration to TF 2.4.1 with Java bindings 0.3.1 #2949 Migrate to TensorFlow 2.4.1 with Cuda 11.x
• Migrate MarianTransformer to TensorFlow v2 architecture and improve ModelSignatureConstants #2960 Migrate MarianTransformer to TensorFlow v2 - use dynamic saveDef
• Map multiple annotations #2975 New functions for mapping annotation columns
• Introducing BatchAnnotate in MarianTransformer #5667 BatchAnnotate for MarianTransformer
• WIP for Review: Doc examples update #4321