Text mining tool for translating terms of contract into technical specifications: Development and application in the railway sector

Tenders or technical terms contain a large quantity of both technical, legal, managerial information mixed in a nested and complex net of relationships. Extracting technical and design information from a document whose aim is both legal and technical, and that is written using several specific jargons, is not a trivial task: the purpose of the research is to try to detect, extract, split and assign information from the text of a tender in an automatic way. It means being able to understand technical and legal terms and organize them in multiple ways: according to product structure, internal organisational structure, etc. The focus is in providing a handy tool that could speed up and facilitate human analysis and allow tackling also the process of transforming customer's requirements into design specifications. The approach chosen to overcome the various issues is to support state-of-the-art Computational Linguistic tools with a wide Knowledge Base. The latter has been constructed both manually and automatically and comprises not only keywords but also concepts, relationships and regular expressions. The implementation of the methodology has been carried out during a project for AnsaldoBreda S.p.A. (now Hitachi Rail Europe). A case study about the tender for a high-speed train has been included to show the functioning and output of the entire software system. (C) 2020 Elsevier B.V. All rights reserved.

Automated summary

The research focuses on automatically detecting, extracting, splitting, and assigning technical and design information from tender documents to facilitate human analysis and transform customer requirements into design specifications. The approach combines state-of-the-art Computational Linguistic tools with a wide Knowledge Base to overcome various issues, with a case study included to demonstrate the functioning and output of the entire software system.