Francesco De Toni

Search results

• 2022

  Entities, Dates, and Languages: Zero-Shot on Historical Texts with T0

  De Toni, F., Akiki, C., de la Rosa, J., Fourrier, C., Manjavacas, E., Schweter, S. & van Strien, D., May 2022, Proceedings of BigScience Episode #5: Workshop on Challenges & Perspectives in Creating Large Language Models. Fan, A., Ilic, S., Wolf, T. & Gallé, M. (eds.). USA: Association for Computational Linguistics, p. 75-83 9 p.

  Research output: Chapter in Book/Conference paper › Conference paper › peer-review

  • Named Entity Recognition 100%
  • Time Period 100%
  • Naïve Approach 50%

• The BigScience ROOTS Corpus: A 1.6TB composite multilingual dataset

  Laurençon, H., Saulnier, L., Wang, T., Akiki, C., Villanova del Moral, A., Le Scao, T., von Werra, L., Mou, C., González Ponferrada, E., Nguyen, H., Frohberg, J., Šaško, M., Lhoest, Q., Mcmillan-Major, A., Dupont, G., Biderman, S., Rogers, A., Ben Allal, L., de Toni, F., Pistilli, G., & 34 othersNguyen, O., Nikpoor, S., Masoud, M., Colombo, P., de la Rosa, J., Villegas, P., Thrush, T., Longpre, S., Nagel, S., Weber, L., Romero Muñoz, M., Zhu, J., van Strien, D., Alyafeai, Z., Almubarak, K., Chien, V. M., Gonzalez-Dios, I., Soroa, A., Lo, K., Dey, M., Ortiz Suarez, P., Gokaslan, A., Bose, S., Adelani, D. I., Phan, L., Tran, H., Yu, I., Pai, S., Chim, J., Lepercq, V., Ilić, S., Mitchell, M., Luccioni, S. & Jernite, Y., 2022, Advances in Neural Information Processing Systems 35 (NeurIPS 2022). New Orleans, United States: Neural Information Processing Systems Foundation, Inc. (NeurIPS)

  Research output: Chapter in Book/Conference paper › Conference paper › peer-review

  Open Access

  • Multi-lingual 100%
  • Corpus 80%
  • Language Modeling 60%
  • Source text 40%
  • Text 20%