Séminaire SoSySec : NEAT: A Nile-English Aligned Translation Corpus based on a Robust Methodology for Intent Based Networking and Security

The rise of Intent Based Networking (IBN) has paved the way for more efficient network and security management, reduced errors, and accelerated deployment times by leveraging AI processes capable of translating natural language intents into policies or configurations. Specialized neural networks could offer a promising solution at the core of translation operations. Still, they require dedicated, large-scale corpora for training generative models, which are not currently available due to the restricted and confidential nature of the information they convey. This talk fills this gap by proposing a novel methodology for creating a corpus specifically tailored to train a Large Language Model (LLM) for this translation task. Our approach leverages advancements in Natural Language Processing (NLP) to overcome the challenges posed by the limited training data, enabling accurate interpretation and translation of high-level performance and security directives from natural language into structured, actionable formats, represented by the intermediate Network Intent LanguagE (Nile). Our experimental evaluations, grounded by human experts, indicate that our corpus generation methodology yields promising results in terms of translation accuracy, language naturalness, and reliability. To further ensure the correctness of the produced translations, our evaluation framework compares and classifies LLM outputs, assessing their semantic fidelity. This process minimizes the risk of incorrect or unsafe intent translations by filtering out translations that fail to meet stringent accuracy criteria. As a result, we have been able to generate Nile-English Aligned Translations (NEAT), a corpus which is to date two orders of magnitude larger than currently available datasets, exhibits a wide coverage of the Nile syntax, and has much lower perplexity values than other generated corpora. NEAT has been made publicly available to facilitate further research and development in adapting generative models to network management and security.

----------------------------------------------------------------------
To follow the presentation remotely, please connect to the following URL with a modern web browser:
- URL: https://webinaire.numerique.gouv.fr/meeting/signin/invite/43499/creator/22714/hash/2504b153fb57548dd70dc97a77c3fe579bd445cb
- Alternative audio access by phone will be possible but the parameters will figure in the web session only a few minutes before the presentation.

----------------------------------------------------------------------

Seminar taking place in person with mandatory registration at least 48h beforehand for *all* in-person participants by email to Nadia Derouault nadia [*] derouaultinria [*] fr (<nadia[dot]derouault[at]inria[dot]fr>). Participants non-affiliated with Inria or IRISA will be asked to present an ID at the reception desk of the IRISA building.

To receive the SoSySec announcements, please subscribe to the SoSySec mailing list:
https://sympa.inria.fr/sympa/subscribe/sosysec
All past and future SoSySec talks are listed at
https://www.creachlabs.fr/en/seminars-keeping-date-latest-research/sosysec-seminar
----------------------------------------------------------------------

Séminaire en présentiel ouvert à tous mais avec inscription obligatoire au moins 48h à l'avance pour *tous* les participants en présentiel auprès de Nadia Derouault nadia [*] derouaultinria [*] fr (<nadia[dot]derouault[at]inria[dot]fr>). Les participants externes devront se présenter à l'accueil avec une pièce d'identité.

Vous pouvez vous abonner à nos annonces de séminaires :
https://sympa.inria.fr/sympa/subscribe/sosysec
et consulter la liste des exposés passés et à venir :
https://www.creachlabs.fr/en/seminars-keeping-date-latest-research/sosysec-seminar