lynx   »   [go: up one dir, main page]

https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/ai-services/openai/includes/chat-markup-language.md) and other chat templates: https://huggingface.co/docs/transformers/main/en/chat_templating.

\n","updatedAt":"2024-03-14T15:36:37.278Z","author":{"_id":"65d7644d19bf1e60614dee6e","avatarUrl":"/avatars/422a8d28fa9d9ff2c3ec1406352cb346.svg","fullname":"Surya Bhupatiraju","name":"suryabhupa","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":14}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8101531267166138},"editors":["suryabhupa"],"editorAvatarUrls":["/avatars/422a8d28fa9d9ff2c3ec1406352cb346.svg"],"reactions":[],"isReport":false,"parentCommentId":"65f2d06aeab8c7a8a5dea83c"}},{"id":"65f458be806b146485a859ac","author":{"_id":"63343d70bc939e4bfd108945","avatarUrl":"/avatars/5106846d97a2a441c752526d0903fbb0.svg","fullname":"Paul Moseley","name":"Excession2501","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false},"createdAt":"2024-03-15T14:18:38.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"Thanks Surya, that's very kind of you. \n\nReading the links you referenced has helped to flesh out my understanding and opened up resources I had not discovered before. \n\nThank you again! ","html":"

Thanks Surya, that's very kind of you.

\n

Reading the links you referenced has helped to flesh out my understanding and opened up resources I had not discovered before.

\n

Thank you again!

\n","updatedAt":"2024-03-15T14:18:38.431Z","author":{"_id":"63343d70bc939e4bfd108945","avatarUrl":"/avatars/5106846d97a2a441c752526d0903fbb0.svg","fullname":"Paul Moseley","name":"Excession2501","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.9900354146957397},"editors":["Excession2501"],"editorAvatarUrls":["/avatars/5106846d97a2a441c752526d0903fbb0.svg"],"reactions":[{"reaction":"πŸ‘","users":["suryabhupa"],"count":1}],"isReport":false,"parentCommentId":"65f2d06aeab8c7a8a5dea83c"}}]},{"id":"65f3a2cc68c1c2c2b135fb5b","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":264},"createdAt":"2024-03-15T01:22:20.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"This is an automated message from the [Librarian Bot](https://huggingface.co/librarian-bots). I found the following papers similar to this paper. \n\nThe following papers were recommended by the Semantic Scholar API \n\n* [OLMo: Accelerating the Science of Language Models](https://huggingface.co/papers/2402.00838) (2024)\n* [Airavata: Introducing Hindi Instruction-tuned LLM](https://huggingface.co/papers/2401.15006) (2024)\n* [H2O-Danube-1.8B Technical Report](https://huggingface.co/papers/2401.16818) (2024)\n* [PHOENIX: Open-Source Language Adaption for Direct Preference Optimization](https://huggingface.co/papers/2401.10580) (2024)\n* [DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning](https://huggingface.co/papers/2402.09136) (2024)\n\n\n Please give a thumbs up to this comment if you found it helpful!\n\n If you want recommendations for any Paper on Hugging Face checkout [this](https://huggingface.co/spaces/librarian-bots/recommend_similar_papers) Space\n\n You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: `@librarian-bot recommend`","html":"

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

\n

The following papers were recommended by the Semantic Scholar API

\n\n

Please give a thumbs up to this comment if you found it helpful!

\n

If you want recommendations for any Paper on Hugging Face checkout this Space

\n

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: \n\n@librarian-bot\n\t recommend

\n","updatedAt":"2024-03-15T01:22:20.642Z","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":264}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7361777424812317},"editors":["librarian-bot"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg"],"reactions":[],"isReport":false}},{"id":"6664a8720c54dffcd2f26a43","author":{"_id":"6186ddf6a7717cb375090c01","avatarUrl":"/avatars/716b6a7d1094c8036b2a8a7b9063e8aa.svg","fullname":"Julien BLANCHON","name":"blanchon","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":142},"createdAt":"2024-06-08T18:52:34.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"# Gemma: Open-Sourced AI Excellence Derived from Google's Gemini \n\nhttps://cdn-uploads.huggingface.co/production/uploads/6186ddf6a7717cb375090c01/CDH-S1I7bs5FWxTHsOFkS.mp4 \n\n## Links πŸ”—:\nπŸ‘‰ Subscribe: https://www.youtube.com/@Arxflix\nπŸ‘‰ Twitter: https://x.com/arxflix\nπŸ‘‰ LMNT (Partner): https://lmnt.com/\n\n\nBy Arxflix\n![9t4iCUHx_400x400-1.jpg](https://cdn-uploads.huggingface.co/production/uploads/6186ddf6a7717cb375090c01/v4S5zBurs0ouGNwYj1GEd.jpeg)","html":"

Gemma: Open-Sourced AI Excellence Derived from Google's Gemini

\n

\n\n

Links πŸ”—:

\n

πŸ‘‰ Subscribe: https://www.youtube.com/@Arxflix
πŸ‘‰ Twitter: https://x.com/arxflix
πŸ‘‰ LMNT (Partner): https://lmnt.com/

\n

By Arxflix
\"9t4iCUHx_400x400-1.jpg\"

\n","updatedAt":"2024-06-08T18:52:34.639Z","author":{"_id":"6186ddf6a7717cb375090c01","avatarUrl":"/avatars/716b6a7d1094c8036b2a8a7b9063e8aa.svg","fullname":"Julien BLANCHON","name":"blanchon","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":142}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.5646283030509949},"editors":["blanchon"],"editorAvatarUrls":["/avatars/716b6a7d1094c8036b2a8a7b9063e8aa.svg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2403.08295","authors":[{"_id":"65f26e7030e67a5682a27711","name":"Gemma Team","hidden":false},{"_id":"65f26e7030e67a5682a27712","name":"Thomas Mesnard","hidden":false},{"_id":"65f26e7030e67a5682a27713","name":"Cassidy Hardin","hidden":false},{"_id":"65f26e7030e67a5682a27714","name":"Robert Dadashi","hidden":false},{"_id":"65f26e7030e67a5682a27715","user":{"_id":"65d7644d19bf1e60614dee6e","avatarUrl":"/avatars/422a8d28fa9d9ff2c3ec1406352cb346.svg","isPro":false,"fullname":"Surya Bhupatiraju","user":"suryabhupa","type":"user"},"name":"Surya Bhupatiraju","status":"claimed_verified","statusLastChangedAt":"2024-03-14T16:31:54.757Z","hidden":false},{"_id":"65f26e7030e67a5682a27716","name":"Shreya Pathak","hidden":false},{"_id":"65f26e7030e67a5682a27717","user":{"_id":"65d74b9b7713dc8fd8956d1c","avatarUrl":"/avatars/5d5873861134bb079753c48304a7b7c2.svg","isPro":false,"fullname":"Laurent Sifre","user":"laurentsifre","type":"user"},"name":"Laurent Sifre","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:48:35.664Z","hidden":false},{"_id":"65f26e7030e67a5682a27718","name":"Morgane Rivière","hidden":false},{"_id":"65f26e7030e67a5682a27719","user":{"_id":"6226953f7551f131b4eba5c5","avatarUrl":"/avatars/eec8fa43fc37f546d9fef118a138d8a4.svg","isPro":false,"fullname":"Mihir Sanjay Kale","user":"mihirkale","type":"user"},"name":"Mihir Sanjay Kale","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:48:49.954Z","hidden":false},{"_id":"65f26e7030e67a5682a2771a","name":"Juliette Love","hidden":false},{"_id":"65f26e7030e67a5682a2771b","user":{"_id":"6558091ecafc48de36f848a8","avatarUrl":"/avatars/3b7e8327d369436d02fe8c58dde036c2.svg","isPro":false,"fullname":"Pouya Tafti","user":"pdt","type":"user"},"name":"Pouya Tafti","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:48:59.357Z","hidden":false},{"_id":"65f26e7030e67a5682a2771c","user":{"_id":"667a7b2e1764931987803b46","avatarUrl":"/avatars/da2ee162f33c681e3d1c4d1e6d44dcbd.svg","isPro":false,"fullname":"Léonard Hussenot","user":"leonardhussenot","type":"user"},"name":"Léonard Hussenot","status":"claimed_verified","statusLastChangedAt":"2025-03-28T14:22:42.993Z","hidden":false},{"_id":"65f26e7030e67a5682a2771d","user":{"_id":"64e3bd0d58579025cbab1199","avatarUrl":"/avatars/5c1b733c121be15f121630e8756990d0.svg","isPro":false,"fullname":"Aakanksha Chowdhery","user":"achowdhery","type":"user"},"name":"Aakanksha Chowdhery","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:49:10.366Z","hidden":false},{"_id":"65f26e7030e67a5682a2771e","name":"Adam Roberts","hidden":false},{"_id":"65f26e7030e67a5682a2771f","user":{"_id":"63cb7741567105596c3f2f05","avatarUrl":"/avatars/1c315a936e2ae04fc5b09d786cc899b7.svg","isPro":false,"fullname":"Aditya","user":"adityabarua","type":"user"},"name":"Aditya Barua","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:49:44.025Z","hidden":false},{"_id":"65f26e7030e67a5682a27720","name":"Alex Botev","hidden":false},{"_id":"65f26e7030e67a5682a27721","name":"Alex Castro-Ros","hidden":false},{"_id":"65f26e7030e67a5682a27722","name":"Ambrose Slone","hidden":false},{"_id":"65f26e7030e67a5682a27723","name":"Amélie Héliou","hidden":false},{"_id":"65f26e7030e67a5682a27724","name":"Andrea Tacchetti","hidden":false},{"_id":"65f26e7030e67a5682a27725","name":"Anna Bulanova","hidden":false},{"_id":"65f26e7030e67a5682a27726","name":"Antonia Paterson","hidden":false},{"_id":"65f26e7030e67a5682a27727","name":"Beth Tsai","hidden":false},{"_id":"65f26e7030e67a5682a27728","name":"Bobak Shahriari","hidden":false},{"_id":"65f26e7030e67a5682a27729","name":"Charline Le Lan","hidden":false},{"_id":"65f26e7030e67a5682a2772a","user":{"_id":"649c5307e89a7650158f4965","avatarUrl":"/avatars/3c71b501db27c86ed686ae26ad1391cd.svg","isPro":false,"fullname":"Christopher A. Choquette-Choo","user":"cchoquette","type":"user"},"name":"Christopher A. Choquette-Choo","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:50:31.382Z","hidden":false},{"_id":"65f26e7030e67a5682a2772b","name":"Clément Crepy","hidden":false},{"_id":"65f26e7030e67a5682a2772c","user":{"_id":"610dd291dda0cb4dbfbf32d2","avatarUrl":"/avatars/6f3fe6d53c37076e2cefc1b4d95743d6.svg","isPro":false,"fullname":"Daniel Cer","user":"danielcer","type":"user"},"name":"Daniel Cer","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:50:53.393Z","hidden":false},{"_id":"65f26e7030e67a5682a2772d","name":"Daphne Ippolito","hidden":false},{"_id":"65f26e7030e67a5682a2772e","name":"David Reid","hidden":false},{"_id":"65f26e7030e67a5682a2772f","user":{"_id":"65da0ecba37e8a543ab732ca","avatarUrl":"/avatars/90889950d8c5e0089ada6b3707104a87.svg","isPro":false,"fullname":"Elena Buchatskaya","user":"ebuchatskaya","type":"user"},"name":"Elena Buchatskaya","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:51:15.733Z","hidden":false},{"_id":"65f26e7030e67a5682a27730","name":"Eric Ni","hidden":false},{"_id":"65f26e7030e67a5682a27731","name":"Eric Noland","hidden":false},{"_id":"65f26e7030e67a5682a27732","user":{"_id":"65f2f6e325b848bd06175cb1","avatarUrl":"/avatars/157b908c632dc81bce331805931239e6.svg","isPro":false,"fullname":"Geng Yan","user":"gengyan","type":"user"},"name":"Geng Yan","status":"claimed_verified","statusLastChangedAt":"2024-03-14T13:23:23.069Z","hidden":false},{"_id":"65f26e7030e67a5682a27733","name":"George Tucker","hidden":false},{"_id":"65f26e7030e67a5682a27734","name":"George-Christian Muraru","hidden":false},{"_id":"65f26e7030e67a5682a27735","name":"Grigory Rozhdestvenskiy","hidden":false},{"_id":"65f26e7030e67a5682a27736","user":{"_id":"6343ead529de2293e7e01889","avatarUrl":"/avatars/dc141ec176bf8b23306be64dbb5b22d1.svg","isPro":false,"fullname":"Henryk Michalewski","user":"henrykmichalewski","type":"user"},"name":"Henryk Michalewski","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:51:55.812Z","hidden":false},{"_id":"65f26e7030e67a5682a27737","user":{"_id":"615b839cae7584e90d765049","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1633387368708-noauth.jpeg","isPro":false,"fullname":"Ian Tenney","user":"iftenney","type":"user"},"name":"Ian Tenney","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:52:03.791Z","hidden":false},{"_id":"65f26e7030e67a5682a27738","user":{"_id":"6625f323495f5402565e8f2e","avatarUrl":"/avatars/f43610554b269b113ac78eb590265860.svg","isPro":false,"fullname":"Ivan Grishchenko","user":"igrishchenko","type":"user"},"name":"Ivan Grishchenko","status":"claimed_verified","statusLastChangedAt":"2024-10-22T08:03:43.719Z","hidden":false},{"_id":"65f26e7030e67a5682a27739","name":"Jacob Austin","hidden":false},{"_id":"65f26e7030e67a5682a2773a","name":"James Keeling","hidden":false},{"_id":"65f26e7030e67a5682a2773b","name":"Jane Labanowski","hidden":false},{"_id":"65f26e7030e67a5682a2773c","name":"Jean-Baptiste Lespiau","hidden":false},{"_id":"65f26e7030e67a5682a2773d","name":"Jeff Stanway","hidden":false},{"_id":"65f26e7030e67a5682a2773e","name":"Jenny Brennan","hidden":false},{"_id":"65f26e7030e67a5682a2773f","name":"Jeremy Chen","hidden":false},{"_id":"65f26e7030e67a5682a27740","user":{"_id":"65afb7dbdd6bdfd73cd8e609","avatarUrl":"/avatars/b21069bc2d7ee4cc1508008e3c8ade64.svg","isPro":false,"fullname":"Johan Ferret","user":"ferretj","type":"user"},"name":"Johan Ferret","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:53:03.109Z","hidden":false},{"_id":"65f26e7030e67a5682a27741","name":"Justin Chiu","hidden":false},{"_id":"65f26e7030e67a5682a27742","name":"Justin Mao-Jones","hidden":false},{"_id":"65f26e7030e67a5682a27743","name":"Katherine Lee","hidden":false},{"_id":"65f26e7030e67a5682a27744","user":{"_id":"650200f0cccc7b28a34bb6b3","avatarUrl":"/avatars/32b680c459b0346e619145d45ae463d3.svg","isPro":false,"fullname":"Kathy Yu","user":"kathy-yu","type":"user"},"name":"Kathy Yu","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:58:18.878Z","hidden":false},{"_id":"65f26e7030e67a5682a27745","name":"Katie Millican","hidden":false},{"_id":"65f26e7030e67a5682a27746","name":"Lars Lowe Sjoesund","hidden":false},{"_id":"65f26e7030e67a5682a27747","name":"Lisa Lee","hidden":false},{"_id":"65f26e7030e67a5682a27748","user":{"_id":"64c25a9c2b1ffc2eecbce31d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64c25a9c2b1ffc2eecbce31d/uTp3yOPdmCSAmhzWwKUjK.png","isPro":false,"fullname":"Lucas Dixon","user":"iislucas","type":"user"},"name":"Lucas Dixon","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:59:42.368Z","hidden":false},{"_id":"65f26e7030e67a5682a27749","user":{"_id":"612d7a89ce7c3822c425d044","avatarUrl":"/avatars/8c050ceea27309cb2d7ab3b9742dc8e6.svg","isPro":false,"fullname":"Machel Reid","user":"machelreid","type":"user"},"name":"Machel Reid","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:58:41.633Z","hidden":false},{"_id":"65f26e7030e67a5682a2774a","name":"Maciej Mikuła","hidden":false},{"_id":"65f26e7030e67a5682a2774b","name":"Mateo Wirth","hidden":false},{"_id":"65f26e7030e67a5682a2774c","name":"Michael Sharman","hidden":false},{"_id":"65f26e7030e67a5682a2774d","name":"Nikolai Chinaev","hidden":false},{"_id":"65f26e7030e67a5682a2774e","user":{"_id":"652853b57149f9d1968a056d","avatarUrl":"/avatars/9d8fc754b5b04d2fd89979401460f1df.svg","isPro":false,"fullname":"Nithum Thain","user":"nitht","type":"user"},"name":"Nithum Thain","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:58:06.247Z","hidden":false},{"_id":"65f26e7030e67a5682a2774f","name":"Olivier Bachem","hidden":false},{"_id":"65f26e7030e67a5682a27750","name":"Oscar Chang","hidden":false},{"_id":"65f26e7030e67a5682a27751","name":"Oscar Wahltinez","hidden":false},{"_id":"65f26e7030e67a5682a27752","user":{"_id":"60f300249b7e6dcb17723f3a","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1642442497120-60f300249b7e6dcb17723f3a.jpeg","isPro":false,"fullname":"Paige Bailey","user":"dynamicwebpaige","type":"user"},"name":"Paige Bailey","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:57:42.483Z","hidden":false},{"_id":"65f26e7030e67a5682a27753","name":"Paul Michel","hidden":false},{"_id":"65f26e7030e67a5682a27754","name":"Petko Yotov","hidden":false},{"_id":"65f26e7030e67a5682a27755","name":"Pier Giuseppe Sessa","hidden":false},{"_id":"65f26e7030e67a5682a27756","name":"Rahma Chaabouni","hidden":false},{"_id":"65f26e7030e67a5682a27757","name":"Ramona Comanescu","hidden":false},{"_id":"65f26e7030e67a5682a27758","name":"Reena Jana","hidden":false},{"_id":"65f26e7030e67a5682a27759","name":"Rohan Anil","hidden":false},{"_id":"65f26e7030e67a5682a2775a","name":"Ross McIlroy","hidden":false},{"_id":"65f26e7030e67a5682a2775b","user":{"_id":"5e91f1554957053f606489ff","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/5e91f1554957053f606489ff/eJty7TksRLwuta0deZTmt.jpeg","isPro":false,"fullname":"Ruibo Liu","user":"agi-css","type":"user"},"name":"Ruibo Liu","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:57:26.181Z","hidden":false},{"_id":"65f26e7030e67a5682a2775c","user":{"_id":"65a402a53522df7a27125823","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/65a402a53522df7a27125823/tVR6lZlKmjPqi7dTZBGoS.jpeg","isPro":false,"fullname":"Ryan Mullins","user":"RyanMullins","type":"user"},"name":"Ryan Mullins","status":"claimed_verified","statusLastChangedAt":"2025-03-28T08:39:26.796Z","hidden":false},{"_id":"65f26e7030e67a5682a2775d","name":"Samuel L Smith","hidden":false},{"_id":"65f26e7030e67a5682a2775e","name":"Sebastian Borgeaud","hidden":false},{"_id":"65f26e7030e67a5682a2775f","name":"Sertan Girgin","hidden":false},{"_id":"65f26e7030e67a5682a27760","name":"Sholto Douglas","hidden":false},{"_id":"65f26e7030e67a5682a27761","name":"Shree Pandya","hidden":false},{"_id":"65f26e7030e67a5682a27762","name":"Siamak Shakeri","hidden":false},{"_id":"65f26e7030e67a5682a27763","user":{"_id":"661415d9f9e58fe02bd8661d","avatarUrl":"/avatars/7a28bb507b8bac72a8b161e774b19fbd.svg","isPro":false,"fullname":"Soham De","user":"sohamde","type":"user"},"name":"Soham De","status":"claimed_verified","statusLastChangedAt":"2025-04-28T13:50:25.430Z","hidden":false},{"_id":"65f26e7030e67a5682a27764","name":"Ted Klimenko","hidden":false},{"_id":"65f26e7030e67a5682a27765","name":"Tom Hennigan","hidden":false},{"_id":"65f26e7030e67a5682a27766","name":"Vlad Feinberg","hidden":false},{"_id":"65f26e7030e67a5682a27767","name":"Wojciech Stokowiec","hidden":false},{"_id":"65f26e7030e67a5682a27768","user":{"_id":"65b98ed22f2022969fc25d3b","avatarUrl":"/avatars/7dd50758944d120acda7b7d0287c5f7a.svg","isPro":false,"fullname":"Yu-Hui Chen","user":"yuhuichen1015","type":"user"},"name":"Yu-hui Chen","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:56:28.088Z","hidden":false},{"_id":"65f26e7030e67a5682a27769","name":"Zafarali Ahmed","hidden":false},{"_id":"65f26e7030e67a5682a2776a","name":"Zhitao Gong","hidden":false},{"_id":"65f26e7030e67a5682a2776b","user":{"_id":"64d51be85e5f05485ca50751","avatarUrl":"/avatars/5802fcc5a5f1e089df41232892f8f502.svg","isPro":false,"fullname":"Tris Warkentin","user":"trisfromgoogle","type":"user"},"name":"Tris Warkentin","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:56:06.639Z","hidden":false},{"_id":"65f26e7030e67a5682a2776c","user":{"_id":"60e473dcdefbf317ecd88035","avatarUrl":"/avatars/e5c069e6cfc73ea5d3d6c2a437490cdd.svg","isPro":false,"fullname":"LUDOVIC PERAN","user":"LudovicPeran","type":"user"},"name":"Ludovic Peran","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:55:47.728Z","hidden":false},{"_id":"65f26e7030e67a5682a2776d","name":"Minh Giang","hidden":false},{"_id":"65f26e7030e67a5682a2776e","user":{"_id":"638a689ef560ea995b57aad4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1670015109688-noauth.jpeg","isPro":false,"fullname":"Clement Farabet","user":"clmnt","type":"user"},"name":"Clément Farabet","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:55:35.213Z","hidden":false},{"_id":"65f26e7030e67a5682a2776f","name":"Oriol Vinyals","hidden":false},{"_id":"65f26e7030e67a5682a27770","name":"Jeff Dean","hidden":false},{"_id":"65f26e7030e67a5682a27771","name":"Koray Kavukcuoglu","hidden":false},{"_id":"65f26e7030e67a5682a27772","name":"Demis Hassabis","hidden":false},{"_id":"65f26e7030e67a5682a27773","name":"Zoubin Ghahramani","hidden":false},{"_id":"65f26e7030e67a5682a27774","name":"Douglas Eck","hidden":false},{"_id":"65f26e7030e67a5682a27775","name":"Joelle Barral","hidden":false},{"_id":"65f26e7030e67a5682a27776","name":"Fernando Pereira","hidden":false},{"_id":"65f26e7030e67a5682a27777","name":"Eli Collins","hidden":false},{"_id":"65f26e7030e67a5682a27778","name":"Armand Joulin","hidden":false},{"_id":"65f26e7030e67a5682a27779","user":{"_id":"62f82ebd870a3f98bbf9e62a","avatarUrl":"/avatars/3b03299e128abf2c8ba82db704855de7.svg","isPro":false,"fullname":"Noah Fiedel","user":"nfiedel","type":"user"},"name":"Noah Fiedel","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:54:30.108Z","hidden":false},{"_id":"65f26e7030e67a5682a2777a","user":{"_id":"62a47ec0fdd7a13aac264904","avatarUrl":"/avatars/f2ff23645203ed2399cfe8b447af437a.svg","isPro":false,"fullname":"Evan Senter","user":"evansenter","type":"user"},"name":"Evan Senter","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:54:06.474Z","hidden":false},{"_id":"65f26e7030e67a5682a2777b","user":{"_id":"65d667858ac5cf899e3b66c4","avatarUrl":"/avatars/340468ee8cd9125eceae23a9b8e536a5.svg","isPro":false,"fullname":"Alek Andreev","user":"alekandreev","type":"user"},"name":"Alek Andreev","status":"admin_assigned","statusLastChangedAt":"2024-03-14T08:53:58.001Z","hidden":false},{"_id":"65f26e7030e67a5682a2777c","name":"Kathleen Kenealy","hidden":false}],"publishedAt":"2024-03-13T06:59:16.000Z","submittedOnDailyAt":"2024-03-14T01:56:40.845Z","title":"Gemma: Open Models Based on Gemini Research and Technology","submittedOnDailyBy":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","isPro":false,"fullname":"AK","user":"akhaliq","type":"user"},"summary":"This work introduces Gemma, a family of lightweight, state-of-the art open\nmodels built from the research and technology used to create Gemini models.\nGemma models demonstrate strong performance across academic benchmarks for\nlanguage understanding, reasoning, and safety. We release two sizes of models\n(2 billion and 7 billion parameters), and provide both pretrained and\nfine-tuned checkpoints. Gemma outperforms similarly sized open models on 11 out\nof 18 text-based tasks, and we present comprehensive evaluations of safety and\nresponsibility aspects of the models, alongside a detailed description of model\ndevelopment. We believe the responsible release of LLMs is critical for\nimproving the safety of frontier models, and for enabling the next wave of LLM\ninnovations.","upvotes":50,"discussionId":"65f26e7030e67a5682a2778e","ai_summary":"Gemma, a family of lightweight and high-performing language models, outperforms similarly sized open models across text-based tasks and emphasizes the importance of responsible model development and safety.","ai_keywords":["lightweight","state-of-the art open models","Gemma","Gemini models","language understanding","reasoning","safety","pretrained","fine-tuned checkpoints","LLMs","text-based tasks","blameability","responsibility aspects","model development"]},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"630c2ddb86b8b9904c3860a6","avatarUrl":"/avatars/9b6cec2e9e269ccac1533eb7bf1ac2c5.svg","isPro":false,"fullname":"Igor Melnyk","user":"imelnyk","type":"user"},{"_id":"620783f24e28382272337ba4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/620783f24e28382272337ba4/zkUveQPNiDfYjgGhuFErj.jpeg","isPro":false,"fullname":"GuoLiangTang","user":"Tommy930","type":"user"},{"_id":"6033c55f60e3dd96631c908d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6033c55f60e3dd96631c908d/jy7cHHCBhnlzHKGbXIbj0.jpeg","isPro":false,"fullname":"Shyam Sunder Kumar","user":"theainerd","type":"user"},{"_id":"64747f7e33192631bacd8831","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/64747f7e33192631bacd8831/dstkZJ4sHJSeqLesV5cOC.jpeg","isPro":false,"fullname":"Taufiq Dwi Purnomo","user":"taufiqdp","type":"user"},{"_id":"6366b56ecbf2cf329189777e","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1667675471625-noauth.jpeg","isPro":false,"fullname":"Yuchen Cheng","user":"rudeigerc","type":"user"},{"_id":"62fadca70697d22421a05a36","avatarUrl":"/avatars/ce9fd5d70f56a903a5d0f4de9f6f4034.svg","isPro":false,"fullname":"jineui-kim","user":"engui","type":"user"},{"_id":"61bd6bbb92dd56338582ebbd","avatarUrl":"/avatars/3637ab04f9342cf15340a47c9645722a.svg","isPro":false,"fullname":"Imam Nur Bani Yusuf","user":"imamnurby","type":"user"},{"_id":"655ac762cb17ec19ef82719b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/655ac762cb17ec19ef82719b/1kDncYrGLYS_2SR8cNdAL.png","isPro":false,"fullname":"Welcome to matlok","user":"matlok","type":"user"},{"_id":"62d05322dd7bdfc5e5c86298","avatarUrl":"/avatars/62879c8a8bbdbaaf63da27a44e90bd5f.svg","isPro":false,"fullname":"Mahdi Pourmirzaei","user":"Mahdip72","type":"user"},{"_id":"6538119803519fddb4a17e10","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6538119803519fddb4a17e10/ffJMkdx-rM7VvLTCM6ri_.jpeg","isPro":false,"fullname":"samusenps","user":"samusenps","type":"user"},{"_id":"647a396b0e1b08786fb05f62","avatarUrl":"/avatars/ba77efc8f4422d3869eb01851da6f8b9.svg","isPro":false,"fullname":"Beech","user":"Finleym","type":"user"},{"_id":"6555125a4f361968f0e3aad7","avatarUrl":"/avatars/e7692d82804338f21ecdc6e731f5c5ea.svg","isPro":false,"fullname":"marinaretikof","user":"marinaretik","type":"user"}],"acceptLanguages":["*"],"dailyPaperRank":2}">
Papers
arxiv:2403.08295

Gemma: Open Models Based on Gemini Research and Technology

Published on Mar 13, 2024
Β· Submitted by AK on Mar 14, 2024
#2 Paper of the day
Authors:
,
,
,
,
,
,
,
,
,
,
,
,
,
,

Abstract

Gemma, a family of lightweight and high-performing language models, outperforms similarly sized open models across text-based tasks and emphasizes the importance of responsible model development and safety.

AI-generated summary

This work introduces Gemma, a family of lightweight, state-of-the art open models built from the research and technology used to create Gemini models. Gemma models demonstrate strong performance across academic benchmarks for language understanding, reasoning, and safety. We release two sizes of models (2 billion and 7 billion parameters), and provide both pretrained and fine-tuned checkpoints. Gemma outperforms similarly sized open models on 11 out of 18 text-based tasks, and we present comprehensive evaluations of safety and responsibility aspects of the models, alongside a detailed description of model development. We believe the responsible release of LLMs is critical for improving the safety of frontier models, and for enabling the next wave of LLM innovations.

Community

I was curious reading the section on the formatting used for the instruction tuning (pg4), where the developers used special tokens such as 'user' and 'model' to denote who is speaking. I have not read much on instruction tuning, so I was wondering if this was standard practice or a novel idea?

Β·
Paper author

Hi, Surya from the Gemma team -- there are different standards for how people demarcate turns and assign roles in fine-tuning data, but some template is almost used!

For instance, you may have seen the ChatML format (https://github.com/MicrosoftDocs/azure-docs/blob/main/articles/ai-services/openai/includes/chat-markup-language.md) and other chat templates: https://huggingface.co/docs/transformers/main/en/chat_templating.

This is an automated message from the Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend

Gemma: Open-Sourced AI Excellence Derived from Google's Gemini

Links πŸ”—:

πŸ‘‰ Subscribe: https://www.youtube.com/@Arxflix
πŸ‘‰ Twitter: https://x.com/arxflix
πŸ‘‰ LMNT (Partner): https://lmnt.com/

By Arxflix
9t4iCUHx_400x400-1.jpg

Sign up or log in to comment

Models citing this paper 133

Browse 133 models citing this paper

Datasets citing this paper 2

Spaces citing this paper 74

Collections including this paper 18

Π›ΡƒΡ‡ΡˆΠΈΠΉ частный хостинг