https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/ai-services/openai/includes/chat-markup-language.md) and other chat templates:
https://huggingface.co/docs/transformers/main/en/chat_templating . \n","updatedAt":"2024-03-14T15:36:37.278Z","author":{"_id":"65d7644d19bf1e60614dee6e","avatarUrl":"/avatars/422a8d28fa9d9ff2c3ec1406352cb346.svg","fullname":"Surya Bhupatiraju","name":"suryabhupa","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":14}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8101531267166138},"editors":["suryabhupa"],"editorAvatarUrls":["/avatars/422a8d28fa9d9ff2c3ec1406352cb346.svg"],"reactions":[],"isReport":false,"parentCommentId":"65f2d06aeab8c7a8a5dea83c"}},{"id":"65f458be806b146485a859ac","author":{"_id":"63343d70bc939e4bfd108945","avatarUrl":"/avatars/5106846d97a2a441c752526d0903fbb0.svg","fullname":"Paul Moseley","name":"Excession2501","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false},"createdAt":"2024-03-15T14:18:38.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Thanks Surya, that's very kind of you. \n\nReading the links you referenced has helped to flesh out my understanding and opened up resources I had not discovered before. \n\nThank you again! ","html":"
Thanks Surya, that's very kind of you.
\n
Reading the links you referenced has helped to flesh out my understanding and opened up resources I had not discovered before.
\n
Thank you again!
\n","updatedAt":"2024-03-15T14:18:38.431Z","author":{"_id":"63343d70bc939e4bfd108945","avatarUrl":"/avatars/5106846d97a2a441c752526d0903fbb0.svg","fullname":"Paul Moseley","name":"Excession2501","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9900354146957397},"editors":["Excession2501"],"editorAvatarUrls":["/avatars/5106846d97a2a441c752526d0903fbb0.svg"],"reactions":[{"reaction":"π","users":["suryabhupa"],"count":1}],"isReport":false,"parentCommentId":"65f2d06aeab8c7a8a5dea83c"}}]},{"id":"65f3a2cc68c1c2c2b135fb5b","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":264},"createdAt":"2024-03-15T01:22:20.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"This is an automated message from the [Librarian Bot](https://huggingface.co/librarian-bots). I found the following papers similar to this paper. \n\nThe following papers were recommended by the Semantic Scholar API \n\n* [OLMo: Accelerating the Science of Language Models](https://huggingface.co/papers/2402.00838) (2024)\n* [Airavata: Introducing Hindi Instruction-tuned LLM](https://huggingface.co/papers/2401.15006) (2024)\n* [H2O-Danube-1.8B Technical Report](https://huggingface.co/papers/2401.16818) (2024)\n* [PHOENIX: Open-Source Language Adaption for Direct Preference Optimization](https://huggingface.co/papers/2401.10580) (2024)\n* [DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning](https://huggingface.co/papers/2402.09136) (2024)\n\n\n Please give a thumbs up to this comment if you found it helpful!\n\n If you want recommendations for any Paper on Hugging Face checkout [this](https://huggingface.co/spaces/librarian-bots/recommend_similar_papers) Space\n\n You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: `@librarian-bot recommend`","html":"
This is an automated message from the Librarian Bot . I found the following papers similar to this paper.
\n
The following papers were recommended by the Semantic Scholar API
\n
\n
Please give a thumbs up to this comment if you found it helpful!
\n
If you want recommendations for any Paper on Hugging Face checkout this Space
\n
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: \n\n@librarian-bot \n\t recommend
\n","updatedAt":"2024-03-15T01:22:20.642Z","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":264}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7361777424812317},"editors":["librarian-bot"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg"],"reactions":[],"isReport":false}},{"id":"6664a8720c54dffcd2f26a43","author":{"_id":"6186ddf6a7717cb375090c01","avatarUrl":"/avatars/716b6a7d1094c8036b2a8a7b9063e8aa.svg","fullname":"Julien BLANCHON","name":"blanchon","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":142},"createdAt":"2024-06-08T18:52:34.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"# Gemma: Open-Sourced AI Excellence Derived from Google's Gemini \n\nhttps://cdn-uploads.huggingface.co/production/uploads/6186ddf6a7717cb375090c01/CDH-S1I7bs5FWxTHsOFkS.mp4 \n\n## Links π:\nπ Subscribe: https://www.youtube.com/@Arxflix\nπ Twitter: https://x.com/arxflix\nπ LMNT (Partner): https://lmnt.com/\n\n\nBy Arxflix\n","html":"
Gemma: Open-Sourced AI Excellence Derived from Google's Gemini \n
\n\n
Links π: \n
π Subscribe: https://www.youtube.com/@Arxflix π Twitter: https://x.com/arxflix π LMNT (Partner): https://lmnt.com/
\n
By Arxflix
\n","updatedAt":"2024-06-08T18:52:34.639Z","author":{"_id":"6186ddf6a7717cb375090c01","avatarUrl":"/avatars/716b6a7d1094c8036b2a8a7b9063e8aa.svg","fullname":"Julien BLANCHON","name":"blanchon","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":142}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.5646283030509949},"editors":["blanchon"],"editorAvatarUrls":["/avatars/716b6a7d1094c8036b2a8a7b9063e8aa.svg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2403.08295","authors":[{"_id":"65f26e7030e67a5682a27711","name":"Gemma Team","hidden":false},{"_id":"65f26e7030e67a5682a27712","name":"Thomas Mesnard","hidden":false},{"_id":"65f26e7030e67a5682a27713","name":"Cassidy Hardin","hidden":false},{"_id":"65f26e7030e67a5682a27714","name":"Robert Dadashi","hidden":false},{"_id":"65f26e7030e67a5682a27715","user":{"_id":"65d7644d19bf1e60614dee6e","avatarUrl":"/avatars/422a8d28fa9d9ff2c3ec1406352cb346.svg","isPro":false,"fullname":"Surya Bhupatiraju","user":"suryabhupa","type":"user"},"name":"Surya Bhupatiraju","status":"claimed_verified","statusLastChangedAt":"2024-03-14T16:31:54.757Z","hidden":false},{"_id":"65f26e7030e67a5682a27716","name":"Shreya Pathak","hidden":false},{"_id":"65f26e7030e67a5682a27717","user":{"_id":"65d74b9b7713dc8fd8956d1c","avatarUrl":"/avatars/5d5873861134bb079753c48304a7b7c2.svg","isPro":false,"fullname":"Laurent Sifre","user":"laurentsifre","type":"user"},"name":"Laurent Sifre","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:48:35.664Z","hidden":false},{"_id":"65f26e7030e67a5682a27718","name":"Morgane RiviΓ¨re","hidden":false},{"_id":"65f26e7030e67a5682a27719","user":{"_id":"6226953f7551f131b4eba5c5","avatarUrl":"/avatars/eec8fa43fc37f546d9fef118a138d8a4.svg","isPro":false,"fullname":"Mihir Sanjay Kale","user":"mihirkale","type":"user"},"name":"Mihir Sanjay Kale","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:48:49.954Z","hidden":false},{"_id":"65f26e7030e67a5682a2771a","name":"Juliette Love","hidden":false},{"_id":"65f26e7030e67a5682a2771b","user":{"_id":"6558091ecafc48de36f848a8","avatarUrl":"/avatars/3b7e8327d369436d02fe8c58dde036c2.svg","isPro":false,"fullname":"Pouya Tafti","user":"pdt","type":"user"},"name":"Pouya Tafti","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:48:59.357Z","hidden":false},{"_id":"65f26e7030e67a5682a2771c","user":{"_id":"667a7b2e1764931987803b46","avatarUrl":"/avatars/da2ee162f33c681e3d1c4d1e6d44dcbd.svg","isPro":false,"fullname":"LΓ©onard Hussenot","user":"leonardhussenot","type":"user"},"name":"LΓ©onard Hussenot","status":"claimed_verified","statusLastChangedAt":"2025-03-28T14:22:42.993Z","hidden":false},{"_id":"65f26e7030e67a5682a2771d","user":{"_id":"64e3bd0d58579025cbab1199","avatarUrl":"/avatars/5c1b733c121be15f121630e8756990d0.svg","isPro":false,"fullname":"Aakanksha Chowdhery","user":"achowdhery","type":"user"},"name":"Aakanksha Chowdhery","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:49:10.366Z","hidden":false},{"_id":"65f26e7030e67a5682a2771e","name":"Adam Roberts","hidden":false},{"_id":"65f26e7030e67a5682a2771f","user":{"_id":"63cb7741567105596c3f2f05","avatarUrl":"/avatars/1c315a936e2ae04fc5b09d786cc899b7.svg","isPro":false,"fullname":"Aditya","user":"adityabarua","type":"user"},"name":"Aditya Barua","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:49:44.025Z","hidden":false},{"_id":"65f26e7030e67a5682a27720","name":"Alex Botev","hidden":false},{"_id":"65f26e7030e67a5682a27721","name":"Alex Castro-Ros","hidden":false},{"_id":"65f26e7030e67a5682a27722","name":"Ambrose Slone","hidden":false},{"_id":"65f26e7030e67a5682a27723","name":"AmΓ©lie HΓ©liou","hidden":false},{"_id":"65f26e7030e67a5682a27724","name":"Andrea Tacchetti","hidden":false},{"_id":"65f26e7030e67a5682a27725","name":"Anna Bulanova","hidden":false},{"_id":"65f26e7030e67a5682a27726","name":"Antonia Paterson","hidden":false},{"_id":"65f26e7030e67a5682a27727","name":"Beth Tsai","hidden":false},{"_id":"65f26e7030e67a5682a27728","name":"Bobak Shahriari","hidden":false},{"_id":"65f26e7030e67a5682a27729","name":"Charline Le Lan","hidden":false},{"_id":"65f26e7030e67a5682a2772a","user":{"_id":"649c5307e89a7650158f4965","avatarUrl":"/avatars/3c71b501db27c86ed686ae26ad1391cd.svg","isPro":false,"fullname":"Christopher A. Choquette-Choo","user":"cchoquette","type":"user"},"name":"Christopher A. Choquette-Choo","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:50:31.382Z","hidden":false},{"_id":"65f26e7030e67a5682a2772b","name":"ClΓ©ment Crepy","hidden":false},{"_id":"65f26e7030e67a5682a2772c","user":{"_id":"610dd291dda0cb4dbfbf32d2","avatarUrl":"/avatars/6f3fe6d53c37076e2cefc1b4d95743d6.svg","isPro":false,"fullname":"Daniel Cer","user":"danielcer","type":"user"},"name":"Daniel Cer","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:50:53.393Z","hidden":false},{"_id":"65f26e7030e67a5682a2772d","name":"Daphne Ippolito","hidden":false},{"_id":"65f26e7030e67a5682a2772e","name":"David Reid","hidden":false},{"_id":"65f26e7030e67a5682a2772f","user":{"_id":"65da0ecba37e8a543ab732ca","avatarUrl":"/avatars/90889950d8c5e0089ada6b3707104a87.svg","isPro":false,"fullname":"Elena Buchatskaya","user":"ebuchatskaya","type":"user"},"name":"Elena Buchatskaya","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:51:15.733Z","hidden":false},{"_id":"65f26e7030e67a5682a27730","name":"Eric Ni","hidden":false},{"_id":"65f26e7030e67a5682a27731","name":"Eric Noland","hidden":false},{"_id":"65f26e7030e67a5682a27732","user":{"_id":"65f2f6e325b848bd06175cb1","avatarUrl":"/avatars/157b908c632dc81bce331805931239e6.svg","isPro":false,"fullname":"Geng Yan","user":"gengyan","type":"user"},"name":"Geng Yan","status":"claimed_verified","statusLastChangedAt":"2024-03-14T13:23:23.069Z","hidden":false},{"_id":"65f26e7030e67a5682a27733","name":"George Tucker","hidden":false},{"_id":"65f26e7030e67a5682a27734","name":"George-Christian Muraru","hidden":false},{"_id":"65f26e7030e67a5682a27735","name":"Grigory Rozhdestvenskiy","hidden":false},{"_id":"65f26e7030e67a5682a27736","user":{"_id":"6343ead529de2293e7e01889","avatarUrl":"/avatars/dc141ec176bf8b23306be64dbb5b22d1.svg","isPro":false,"fullname":"Henryk Michalewski","user":"henrykmichalewski","type":"user"},"name":"Henryk Michalewski","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:51:55.812Z","hidden":false},{"_id":"65f26e7030e67a5682a27737","user":{"_id":"615b839cae7584e90d765049","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1633387368708-noauth.jpeg","isPro":false,"fullname":"Ian Tenney","user":"iftenney","type":"user"},"name":"Ian Tenney","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:52:03.791Z","hidden":false},{"_id":"65f26e7030e67a5682a27738","user":{"_id":"6625f323495f5402565e8f2e","avatarUrl":"/avatars/f43610554b269b113ac78eb590265860.svg","isPro":false,"fullname":"Ivan Grishchenko","user":"igrishchenko","type":"user"},"name":"Ivan Grishchenko","status":"claimed_verified","statusLastChangedAt":"2024-10-22T08:03:43.719Z","hidden":false},{"_id":"65f26e7030e67a5682a27739","name":"Jacob Austin","hidden":false},{"_id":"65f26e7030e67a5682a2773a","name":"James Keeling","hidden":false},{"_id":"65f26e7030e67a5682a2773b","name":"Jane Labanowski","hidden":false},{"_id":"65f26e7030e67a5682a2773c","name":"Jean-Baptiste Lespiau","hidden":false},{"_id":"65f26e7030e67a5682a2773d","name":"Jeff Stanway","hidden":false},{"_id":"65f26e7030e67a5682a2773e","name":"Jenny Brennan","hidden":false},{"_id":"65f26e7030e67a5682a2773f","name":"Jeremy Chen","hidden":false},{"_id":"65f26e7030e67a5682a27740","user":{"_id":"65afb7dbdd6bdfd73cd8e609","avatarUrl":"/avatars/b21069bc2d7ee4cc1508008e3c8ade64.svg","isPro":false,"fullname":"Johan Ferret","user":"ferretj","type":"user"},"name":"Johan Ferret","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:53:03.109Z","hidden":false},{"_id":"65f26e7030e67a5682a27741","name":"Justin Chiu","hidden":false},{"_id":"65f26e7030e67a5682a27742","name":"Justin Mao-Jones","hidden":false},{"_id":"65f26e7030e67a5682a27743","name":"Katherine Lee","hidden":false},{"_id":"65f26e7030e67a5682a27744","user":{"_id":"650200f0cccc7b28a34bb6b3","avatarUrl":"/avatars/32b680c459b0346e619145d45ae463d3.svg","isPro":false,"fullname":"Kathy Yu","user":"kathy-yu","type":"user"},"name":"Kathy Yu","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:58:18.878Z","hidden":false},{"_id":"65f26e7030e67a5682a27745","name":"Katie Millican","hidden":false},{"_id":"65f26e7030e67a5682a27746","name":"Lars Lowe Sjoesund","hidden":false},{"_id":"65f26e7030e67a5682a27747","name":"Lisa Lee","hidden":false},{"_id":"65f26e7030e67a5682a27748","user":{"_id":"64c25a9c2b1ffc2eecbce31d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64c25a9c2b1ffc2eecbce31d/uTp3yOPdmCSAmhzWwKUjK.png","isPro":false,"fullname":"Lucas Dixon","user":"iislucas","type":"user"},"name":"Lucas Dixon","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:59:42.368Z","hidden":false},{"_id":"65f26e7030e67a5682a27749","user":{"_id":"612d7a89ce7c3822c425d044","avatarUrl":"/avatars/8c050ceea27309cb2d7ab3b9742dc8e6.svg","isPro":false,"fullname":"Machel Reid","user":"machelreid","type":"user"},"name":"Machel Reid","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:58:41.633Z","hidden":false},{"_id":"65f26e7030e67a5682a2774a","name":"Maciej MikuΕa","hidden":false},{"_id":"65f26e7030e67a5682a2774b","name":"Mateo Wirth","hidden":false},{"_id":"65f26e7030e67a5682a2774c","name":"Michael Sharman","hidden":false},{"_id":"65f26e7030e67a5682a2774d","name":"Nikolai Chinaev","hidden":false},{"_id":"65f26e7030e67a5682a2774e","user":{"_id":"652853b57149f9d1968a056d","avatarUrl":"/avatars/9d8fc754b5b04d2fd89979401460f1df.svg","isPro":false,"fullname":"Nithum Thain","user":"nitht","type":"user"},"name":"Nithum Thain","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:58:06.247Z","hidden":false},{"_id":"65f26e7030e67a5682a2774f","name":"Olivier Bachem","hidden":false},{"_id":"65f26e7030e67a5682a27750","name":"Oscar Chang","hidden":false},{"_id":"65f26e7030e67a5682a27751","name":"Oscar Wahltinez","hidden":false},{"_id":"65f26e7030e67a5682a27752","user":{"_id":"60f300249b7e6dcb17723f3a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1642442497120-60f300249b7e6dcb17723f3a.jpeg","isPro":false,"fullname":"Paige Bailey","user":"dynamicwebpaige","type":"user"},"name":"Paige Bailey","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:57:42.483Z","hidden":false},{"_id":"65f26e7030e67a5682a27753","name":"Paul Michel","hidden":false},{"_id":"65f26e7030e67a5682a27754","name":"Petko Yotov","hidden":false},{"_id":"65f26e7030e67a5682a27755","name":"Pier Giuseppe Sessa","hidden":false},{"_id":"65f26e7030e67a5682a27756","name":"Rahma Chaabouni","hidden":false},{"_id":"65f26e7030e67a5682a27757","name":"Ramona Comanescu","hidden":false},{"_id":"65f26e7030e67a5682a27758","name":"Reena Jana","hidden":false},{"_id":"65f26e7030e67a5682a27759","name":"Rohan Anil","hidden":false},{"_id":"65f26e7030e67a5682a2775a","name":"Ross McIlroy","hidden":false},{"_id":"65f26e7030e67a5682a2775b","user":{"_id":"5e91f1554957053f606489ff","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5e91f1554957053f606489ff/eJty7TksRLwuta0deZTmt.jpeg","isPro":false,"fullname":"Ruibo Liu","user":"agi-css","type":"user"},"name":"Ruibo Liu","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:57:26.181Z","hidden":false},{"_id":"65f26e7030e67a5682a2775c","user":{"_id":"65a402a53522df7a27125823","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/65a402a53522df7a27125823/tVR6lZlKmjPqi7dTZBGoS.jpeg","isPro":false,"fullname":"Ryan Mullins","user":"RyanMullins","type":"user"},"name":"Ryan Mullins","status":"claimed_verified","statusLastChangedAt":"2025-03-28T08:39:26.796Z","hidden":false},{"_id":"65f26e7030e67a5682a2775d","name":"Samuel L Smith","hidden":false},{"_id":"65f26e7030e67a5682a2775e","name":"Sebastian Borgeaud","hidden":false},{"_id":"65f26e7030e67a5682a2775f","name":"Sertan Girgin","hidden":false},{"_id":"65f26e7030e67a5682a27760","name":"Sholto Douglas","hidden":false},{"_id":"65f26e7030e67a5682a27761","name":"Shree Pandya","hidden":false},{"_id":"65f26e7030e67a5682a27762","name":"Siamak Shakeri","hidden":false},{"_id":"65f26e7030e67a5682a27763","user":{"_id":"661415d9f9e58fe02bd8661d","avatarUrl":"/avatars/7a28bb507b8bac72a8b161e774b19fbd.svg","isPro":false,"fullname":"Soham De","user":"sohamde","type":"user"},"name":"Soham De","status":"claimed_verified","statusLastChangedAt":"2025-04-28T13:50:25.430Z","hidden":false},{"_id":"65f26e7030e67a5682a27764","name":"Ted Klimenko","hidden":false},{"_id":"65f26e7030e67a5682a27765","name":"Tom Hennigan","hidden":false},{"_id":"65f26e7030e67a5682a27766","name":"Vlad Feinberg","hidden":false},{"_id":"65f26e7030e67a5682a27767","name":"Wojciech Stokowiec","hidden":false},{"_id":"65f26e7030e67a5682a27768","user":{"_id":"65b98ed22f2022969fc25d3b","avatarUrl":"/avatars/7dd50758944d120acda7b7d0287c5f7a.svg","isPro":false,"fullname":"Yu-Hui Chen","user":"yuhuichen1015","type":"user"},"name":"Yu-hui Chen","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:56:28.088Z","hidden":false},{"_id":"65f26e7030e67a5682a27769","name":"Zafarali Ahmed","hidden":false},{"_id":"65f26e7030e67a5682a2776a","name":"Zhitao Gong","hidden":false},{"_id":"65f26e7030e67a5682a2776b","user":{"_id":"64d51be85e5f05485ca50751","avatarUrl":"/avatars/5802fcc5a5f1e089df41232892f8f502.svg","isPro":false,"fullname":"Tris Warkentin","user":"trisfromgoogle","type":"user"},"name":"Tris Warkentin","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:56:06.639Z","hidden":false},{"_id":"65f26e7030e67a5682a2776c","user":{"_id":"60e473dcdefbf317ecd88035","avatarUrl":"/avatars/e5c069e6cfc73ea5d3d6c2a437490cdd.svg","isPro":false,"fullname":"LUDOVIC PERAN","user":"LudovicPeran","type":"user"},"name":"Ludovic Peran","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:55:47.728Z","hidden":false},{"_id":"65f26e7030e67a5682a2776d","name":"Minh Giang","hidden":false},{"_id":"65f26e7030e67a5682a2776e","user":{"_id":"638a689ef560ea995b57aad4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1670015109688-noauth.jpeg","isPro":false,"fullname":"Clement Farabet","user":"clmnt","type":"user"},"name":"ClΓ©ment Farabet","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:55:35.213Z","hidden":false},{"_id":"65f26e7030e67a5682a2776f","name":"Oriol Vinyals","hidden":false},{"_id":"65f26e7030e67a5682a27770","name":"Jeff Dean","hidden":false},{"_id":"65f26e7030e67a5682a27771","name":"Koray Kavukcuoglu","hidden":false},{"_id":"65f26e7030e67a5682a27772","name":"Demis Hassabis","hidden":false},{"_id":"65f26e7030e67a5682a27773","name":"Zoubin Ghahramani","hidden":false},{"_id":"65f26e7030e67a5682a27774","name":"Douglas Eck","hidden":false},{"_id":"65f26e7030e67a5682a27775","name":"Joelle Barral","hidden":false},{"_id":"65f26e7030e67a5682a27776","name":"Fernando Pereira","hidden":false},{"_id":"65f26e7030e67a5682a27777","name":"Eli Collins","hidden":false},{"_id":"65f26e7030e67a5682a27778","name":"Armand Joulin","hidden":false},{"_id":"65f26e7030e67a5682a27779","user":{"_id":"62f82ebd870a3f98bbf9e62a","avatarUrl":"/avatars/3b03299e128abf2c8ba82db704855de7.svg","isPro":false,"fullname":"Noah Fiedel","user":"nfiedel","type":"user"},"name":"Noah Fiedel","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:54:30.108Z","hidden":false},{"_id":"65f26e7030e67a5682a2777a","user":{"_id":"62a47ec0fdd7a13aac264904","avatarUrl":"/avatars/f2ff23645203ed2399cfe8b447af437a.svg","isPro":false,"fullname":"Evan Senter","user":"evansenter","type":"user"},"name":"Evan Senter","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:54:06.474Z","hidden":false},{"_id":"65f26e7030e67a5682a2777b","user":{"_id":"65d667858ac5cf899e3b66c4","avatarUrl":"/avatars/340468ee8cd9125eceae23a9b8e536a5.svg","isPro":false,"fullname":"Alek Andreev","user":"alekandreev","type":"user"},"name":"Alek Andreev","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:53:58.001Z","hidden":false},{"_id":"65f26e7030e67a5682a2777c","name":"Kathleen Kenealy","hidden":false}],"publishedAt":"2024-03-13T06:59:16.000Z","submittedOnDailyAt":"2024-03-14T01:56:40.845Z","title":"Gemma: Open Models Based on Gemini Research and Technology","submittedOnDailyBy":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","isPro":false,"fullname":"AK","user":"akhaliq","type":"user"},"summary":"This work introduces Gemma, a family of lightweight, state-of-the art open\nmodels built from the research and technology used to create Gemini models.\nGemma models demonstrate strong performance across academic benchmarks for\nlanguage understanding, reasoning, and safety. We release two sizes of models\n(2 billion and 7 billion parameters), and provide both pretrained and\nfine-tuned checkpoints. Gemma outperforms similarly sized open models on 11 out\nof 18 text-based tasks, and we present comprehensive evaluations of safety and\nresponsibility aspects of the models, alongside a detailed description of model\ndevelopment. We believe the responsible release of LLMs is critical for\nimproving the safety of frontier models, and for enabling the next wave of LLM\ninnovations.","upvotes":50,"discussionId":"65f26e7030e67a5682a2778e","ai_summary":"Gemma, a family of lightweight and high-performing language models, outperforms similarly sized open models across text-based tasks and emphasizes the importance of responsible model development and safety.","ai_keywords":["lightweight","state-of-the art open models","Gemma","Gemini models","language understanding","reasoning","safety","pretrained","fine-tuned checkpoints","LLMs","text-based tasks","blameability","responsibility aspects","model development"]},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"630c2ddb86b8b9904c3860a6","avatarUrl":"/avatars/9b6cec2e9e269ccac1533eb7bf1ac2c5.svg","isPro":false,"fullname":"Igor Melnyk","user":"imelnyk","type":"user"},{"_id":"620783f24e28382272337ba4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/620783f24e28382272337ba4/zkUveQPNiDfYjgGhuFErj.jpeg","isPro":false,"fullname":"GuoLiangTang","user":"Tommy930","type":"user"},{"_id":"6033c55f60e3dd96631c908d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6033c55f60e3dd96631c908d/jy7cHHCBhnlzHKGbXIbj0.jpeg","isPro":false,"fullname":"Shyam Sunder Kumar","user":"theainerd","type":"user"},{"_id":"64747f7e33192631bacd8831","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64747f7e33192631bacd8831/dstkZJ4sHJSeqLesV5cOC.jpeg","isPro":false,"fullname":"Taufiq Dwi Purnomo","user":"taufiqdp","type":"user"},{"_id":"6366b56ecbf2cf329189777e","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1667675471625-noauth.jpeg","isPro":false,"fullname":"Yuchen Cheng","user":"rudeigerc","type":"user"},{"_id":"62fadca70697d22421a05a36","avatarUrl":"/avatars/ce9fd5d70f56a903a5d0f4de9f6f4034.svg","isPro":false,"fullname":"jineui-kim","user":"engui","type":"user"},{"_id":"61bd6bbb92dd56338582ebbd","avatarUrl":"/avatars/3637ab04f9342cf15340a47c9645722a.svg","isPro":false,"fullname":"Imam Nur Bani Yusuf","user":"imamnurby","type":"user"},{"_id":"655ac762cb17ec19ef82719b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/655ac762cb17ec19ef82719b/1kDncYrGLYS_2SR8cNdAL.png","isPro":false,"fullname":"Welcome to matlok","user":"matlok","type":"user"},{"_id":"62d05322dd7bdfc5e5c86298","avatarUrl":"/avatars/62879c8a8bbdbaaf63da27a44e90bd5f.svg","isPro":false,"fullname":"Mahdi Pourmirzaei","user":"Mahdip72","type":"user"},{"_id":"6538119803519fddb4a17e10","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6538119803519fddb4a17e10/ffJMkdx-rM7VvLTCM6ri_.jpeg","isPro":false,"fullname":"samusenps","user":"samusenps","type":"user"},{"_id":"647a396b0e1b08786fb05f62","avatarUrl":"/avatars/ba77efc8f4422d3869eb01851da6f8b9.svg","isPro":false,"fullname":"Beech","user":"Finleym","type":"user"},{"_id":"6555125a4f361968f0e3aad7","avatarUrl":"/avatars/e7692d82804338f21ecdc6e731f5c5ea.svg","isPro":false,"fullname":"marinaretikof","user":"marinaretik","type":"user"}],"acceptLanguages":["*"],"dailyPaperRank":2}">
Gemma: Open Models Based on Gemini Research and Technology
Published on Mar 13, 2024
Β·
Submitted by
AK
on Mar 14, 2024
#2 Paper of the day
Authors:
Gemma Team
,
Thomas Mesnard
,
Cassidy Hardin
,
Robert Dadashi
,
Shreya Pathak
,
Morgane Rivière
,
Juliette Love
,
Adam Roberts
,
Alex Botev
,
Alex Castro-Ros
,
Ambrose Slone
,
AmΓ©lie HΓ©liou
,
Andrea Tacchetti
,
Anna Bulanova
,
Antonia Paterson
+ 86 authors
Abstract
Gemma, a family of lightweight and high-performing language models, outperforms similarly sized open models across text-based tasks and emphasizes the importance of responsible model development and safety.
This work introduces Gemma , a family of lightweight , state-of-the art open
models built from the research and technology used to create Gemini models .
Gemma models demonstrate strong performance across academic benchmarks for
language understanding , reasoning , and safety . We release two sizes of models
(2 billion and 7 billion parameters), and provide both pretrained and
fine-tuned checkpoints . Gemma outperforms similarly sized open models on 11 out
of 18 text-based tasks , and we present comprehensive evaluations of safety and
responsibility aspects of the models, alongside a detailed description of model
development. We believe the responsible release of LLMs is critical for
improving the safety of frontier models, and for enabling the next wave of LLM
innovations.