Abstract: Semantic text similarity has a crucial role in natural language understanding (NLU), which is intended to evaluate the semantic and relatedness of two texts and produce a similarity score.