Librarian Bot. I found the following papers similar to this paper.

The following papers were recommended by the Semantic Scholar API

Please give a thumbs up to this comment if you found it helpful!

If you want recommendations for any Paper on Hugging Face checkout this Space

You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: \n\n@librarian-bot\n\t recommend

\n","updatedAt":"2024-03-02T01:20:49.692Z","author":{"_id":"63d3e0e8ff1384ce6c5dd17d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg","fullname":"Librarian Bot (Bot)","name":"librarian-bot","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":264}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.7575432062149048},"editors":["librarian-bot"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1674830754237-63d3e0e8ff1384ce6c5dd17d.jpeg"],"reactions":[],"isReport":false}},{"id":"65e5dcd02faa026716f0238c","author":{"_id":"64f07091f5968308c3efc1c4","avatarUrl":"/avatars/558bed930b4878ca6ac125e56060f165.svg","fullname":"James","name":"Jt43","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false},"createdAt":"2024-03-04T14:38:08.000Z","type":"comment","data":{"edited":true,"hidden":true,"hiddenBy":"","latest":{"raw":"This comment has been hidden","html":"This comment has been hidden","updatedAt":"2024-03-04T14:38:26.212Z","author":{"_id":"64f07091f5968308c3efc1c4","avatarUrl":"/avatars/558bed930b4878ca6ac125e56060f165.svg","fullname":"James","name":"Jt43","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false}},"numEdits":0,"editors":[],"editorAvatarUrls":[],"reactions":[]}},{"id":"65e7ea2bc07c64acbffb09a8","author":{"_id":"6381cc73bd4212a0786c0a4d","avatarUrl":"/avatars/b07f461560820019697cf7af0b0165ba.svg","fullname":"Dinh Thi Hong Hieu","name":"Hieudth","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false},"createdAt":"2024-03-06T03:59:39.000Z","type":"comment","data":{"edited":true,"hidden":true,"hiddenBy":"","latest":{"raw":"This comment has been hidden","html":"This comment has been hidden","updatedAt":"2024-03-06T03:59:53.400Z","author":{"_id":"6381cc73bd4212a0786c0a4d","avatarUrl":"/avatars/b07f461560820019697cf7af0b0165ba.svg","fullname":"Dinh Thi Hong Hieu","name":"Hieudth","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false}},"numEdits":0,"editors":[],"editorAvatarUrls":[],"reactions":[]}},{"id":"666591fc8f5513b0cf728a94","author":{"_id":"6186ddf6a7717cb375090c01","avatarUrl":"/avatars/716b6a7d1094c8036b2a8a7b9063e8aa.svg","fullname":"Julien BLANCHON","name":"blanchon","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":142},"createdAt":"2024-06-09T11:29:00.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"# Byte Models: Simulating the Digital World with bGPT\n\nhttps://cdn-uploads.huggingface.co/production/uploads/6186ddf6a7717cb375090c01/jAQ-iFSqo9eiLS8Tl7J2z.mp4 \n\n## Links 🔗:\n👉 Subscribe: https://www.youtube.com/@Arxflix\n👉 Twitter: https://x.com/arxflix\n👉 LMNT (Partner): https://lmnt.com/\n\n\nBy Arxflix\n![9t4iCUHx_400x400-1.jpg](https://cdn-uploads.huggingface.co/production/uploads/6186ddf6a7717cb375090c01/v4S5zBurs0ouGNwYj1GEd.jpeg)","html":"

Byte Models: Simulating the Digital World with bGPT

\n\n

Links 🔗:

👉 Subscribe: https://www.youtube.com/@Arxflix
👉 Twitter: https://x.com/arxflix
👉 LMNT (Partner): https://lmnt.com/

By Arxflix
$\"9t4iCUHx_400x400-1.jpg\"$

\n","updatedAt":"2024-06-09T11:29:00.102Z","author":{"_id":"6186ddf6a7717cb375090c01","avatarUrl":"/avatars/716b6a7d1094c8036b2a8a7b9063e8aa.svg","fullname":"Julien BLANCHON","name":"blanchon","type":"user","isPro":true,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":142}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.48643577098846436},"editors":["blanchon"],"editorAvatarUrls":["/avatars/716b6a7d1094c8036b2a8a7b9063e8aa.svg"],"reactions":[],"isReport":false}}],"primaryEmailConfirmed":false,"paper":{"id":"2402.19155","authors":[{"_id":"65e15544ae0a6579208a7048","name":"Shangda Wu","hidden":false},{"_id":"65e15544ae0a6579208a7049","user":{"_id":"5f1040b6e9d71719e3be71d2","avatarUrl":"/avatars/a2f28940236ae625ed3810ad62e343ff.svg","isPro":false,"fullname":"Xu Tan","user":"xutan","type":"user"},"name":"Xu Tan","status":"admin_assigned","statusLastChangedAt":"2024-03-01T10:40:18.447Z","hidden":false},{"_id":"65e15544ae0a6579208a704a","user":{"_id":"6410998db27543634e3aacc3","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1678809388600-noauth.png","isPro":false,"fullname":"Zili Wang","user":"MarkWang","type":"user"},"name":"Zili Wang","status":"admin_assigned","statusLastChangedAt":"2024-03-01T10:41:11.865Z","hidden":false},{"_id":"65e15544ae0a6579208a704b","name":"Rui Wang","hidden":false},{"_id":"65e15544ae0a6579208a704c","name":"Xiaobing Li","hidden":false},{"_id":"65e15544ae0a6579208a704d","name":"Maosong Sun","hidden":false}],"publishedAt":"2024-02-29T13:38:07.000Z","submittedOnDailyAt":"2024-03-01T02:21:30.526Z","title":"Beyond Language Models: Byte Models are Digital World Simulators","submittedOnDailyBy":{"_id":"60f1abe7544c2adfd699860c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1674929746905-60f1abe7544c2adfd699860c.jpeg","isPro":false,"fullname":"AK","user":"akhaliq","type":"user"},"summary":"Traditional deep learning often overlooks bytes, the basic units of the\ndigital world, where all forms of information and operations are encoded and\nmanipulated in binary format. Inspired by the success of next token prediction\nin natural language processing, we introduce bGPT, a model with next byte\nprediction to simulate the digital world. bGPT matches specialized models in\nperformance across various modalities, including text, audio, and images, and\noffers new possibilities for predicting, simulating, and diagnosing algorithm\nor hardware behaviour. It has almost flawlessly replicated the process of\nconverting symbolic music data, achieving a low error rate of 0.0011 bits per\nbyte in converting ABC notation to MIDI format. In addition, bGPT demonstrates\nexceptional capabilities in simulating CPU behaviour, with an accuracy\nexceeding 99.99% in executing various operations. Leveraging next byte\nprediction, models like bGPT can directly learn from vast binary data,\neffectively simulating the intricate patterns of the digital world.","upvotes":53,"discussionId":"65e15544ae0a6579208a7063","ai_summary":"bGPT, a model using next byte prediction, simulates various digital processes with high accuracy, matching specialized models in performance and offering insights into algorithm and hardware behavior.","ai_keywords":["bGPT","next byte prediction","ABC notation","MIDI format","digital world","symbolic music data","CPU behaviour"]},"canReadDatabase":false,"canManagePapers":false,"canSubmit":false,"hasHfLevelAccess":false,"upvoted":false,"upvoters":[{"_id":"635964636a61954080850e1d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/635964636a61954080850e1d/0bfExuDTrHTtm8c-40cDM.png","isPro":false,"fullname":"William Lamkin","user":"phanes","type":"user"},{"_id":"6538119803519fddb4a17e10","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6538119803519fddb4a17e10/ffJMkdx-rM7VvLTCM6ri_.jpeg","isPro":false,"fullname":"samusenps","user":"samusenps","type":"user"},{"_id":"61e7c06064d3c6c929057bee","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61e7c06064d3c6c929057bee/QxULx1EA1bgmjXxupQX4B.jpeg","isPro":false,"fullname":"蓋瑞王","user":"gary109","type":"user"},{"_id":"644a8fb81acffad9353cc685","avatarUrl":"/avatars/7f713993c6d352ce805132aea6bd7b2e.svg","isPro":false,"fullname":"he","user":"hedes","type":"user"},{"_id":"620783f24e28382272337ba4","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/620783f24e28382272337ba4/zkUveQPNiDfYjgGhuFErj.jpeg","isPro":false,"fullname":"GuoLiangTang","user":"Tommy930","type":"user"},{"_id":"63119cc5af10c9efa1e9b620","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/63119cc5af10c9efa1e9b620/RA-UgDNTPsF6j5uDnG3-N.jpeg","isPro":false,"fullname":"Akarshan Biswas","user":"qnixsynapse","type":"user"},{"_id":"62fca7a603f8664622033381","avatarUrl":"/avatars/9b1bdf9acc6990c2da4ed9bfdab54ade.svg","isPro":false,"fullname":"Nikita Arsenin","user":"lumirey","type":"user"},{"_id":"631e40a4b07bce5f2a7faa38","avatarUrl":"/avatars/999e8f6a820d7145b60a99eb16bd7f35.svg","isPro":false,"fullname":"Ogbogu Kalu","user":"ogkalu","type":"user"},{"_id":"6039478ab3ecf716b1a5fd4d","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/6039478ab3ecf716b1a5fd4d/_Thy4E7taiSYBLKxEKJbT.jpeg","isPro":true,"fullname":"taesiri","user":"taesiri","type":"user"},{"_id":"60c8d264224e250fb0178f77","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/60c8d264224e250fb0178f77/i8fbkBVcoFeJRmkQ9kYAE.png","isPro":true,"fullname":"Adam Lee","user":"Abecid","type":"user"},{"_id":"6432eacd4521083b9d28028b","avatarUrl":"/avatars/cf17d43a2d888923ed4dc72343b1dd8a.svg","isPro":false,"fullname":"Harrison Long","user":"nattybones","type":"user"},{"_id":"61c8701dccae6d3b4a6c004b","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/61c8701dccae6d3b4a6c004b/fO-kXOBdyXMF3Vg77D1HB.png","isPro":false,"fullname":"Ugur Akdogan","user":"balicien","type":"user"}],"acceptLanguages":["*"],"dailyPaperRank":3}">

Papers

arxiv:2402.19155

Beyond Language Models: Byte Models are Digital World Simulators

Published on Feb 29, 2024

· Submitted by

AK on Mar 1, 2024

#3 Paper of the day

Upvote

Authors:

Xu Tan ,

Zili Wang ,

Abstract

bGPT, a model using next byte prediction, simulates various digital processes with high accuracy, matching specialized models in performance and offering insights into algorithm and hardware behavior.

AI-generated summary

Traditional deep learning often overlooks bytes, the basic units of the digital world, where all forms of information and operations are encoded and manipulated in binary format. Inspired by the success of next token prediction in natural language processing, we introduce bGPT, a model with next byte prediction to simulate the digital world. bGPT matches specialized models in performance across various modalities, including text, audio, and images, and offers new possibilities for predicting, simulating, and diagnosing algorithm or hardware behaviour. It has almost flawlessly replicated the process of converting symbolic music data, achieving a low error rate of 0.0011 bits per byte in converting ABC notation to MIDI format. In addition, bGPT demonstrates exceptional capabilities in simulating CPU behaviour, with an accuracy exceeding 99.99% in executing various operations. Leveraging next byte prediction, models like bGPT can directly learn from vast binary data, effectively simulating the intricate patterns of the digital world.