@sryadava\n\t
Yes it is expected,
Yes it is expected,
bitsandbytes
is not supported on MacOS devices\n","updatedAt":"2024-03-04T00:52:40.338Z","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8596454858779907},"editors":["ybelkada"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png"],"reactions":[],"isReport":false}},{"id":"65e55e74a0681de6302333a3","author":{"_id":"65e1eaae60db3642556c588c","avatarUrl":"/avatars/784579216b80a3f60c07ab6878e29b5d.svg","fullname":"SreeSindhuSruthiYadavalli","name":"sryadava","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isOwner":false,"isOrgMember":false},"createdAt":"2024-03-04T05:39:00.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"@ybelkada ,\n\nThen we have to modify the code and update it for mac users. Can I raise a pull request for the same?","html":"\n\n@ybelkada\n\t ,
\nThen we have to modify the code and update it for mac users. Can I raise a pull request for the same?
\n","updatedAt":"2024-03-04T05:39:00.818Z","author":{"_id":"65e1eaae60db3642556c588c","avatarUrl":"/avatars/784579216b80a3f60c07ab6878e29b5d.svg","fullname":"SreeSindhuSruthiYadavalli","name":"sryadava","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8225404024124146},"editors":["sryadava"],"editorAvatarUrls":["/avatars/784579216b80a3f60c07ab6878e29b5d.svg"],"reactions":[],"isReport":false}},{"id":"65e56dc8edc2f7306ed5f6ac","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503,"isOwner":false,"isOrgMember":false},"createdAt":"2024-03-04T06:44:24.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"yes feel free to do so and ping me for a review!","html":"yes feel free to do so and ping me for a review!
\n","updatedAt":"2024-03-04T06:44:24.698Z","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8987091183662415},"editors":["ybelkada"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png"],"reactions":[],"isReport":false}}],"pinned":false,"locked":false,"collection":"discussions","isPullRequest":false,"isReport":false},"repo":{"name":"google/gemma-7b","type":"model"},"activeTab":"discussion","discussionRole":0,"watched":false,"muted":false,"repoDiscussionsLocked":false}">quantization won't work on mac silicon devices
#55
by
sryadava
- opened
@sryadava\n\t
Yes it is expected,
Yes it is expected,
bitsandbytes
is not supported on MacOS devices\n","updatedAt":"2024-03-04T00:52:40.338Z","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8596454858779907},"editors":["ybelkada"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png"],"reactions":[],"isReport":false}},{"id":"65e55e74a0681de6302333a3","author":{"_id":"65e1eaae60db3642556c588c","avatarUrl":"/avatars/784579216b80a3f60c07ab6878e29b5d.svg","fullname":"SreeSindhuSruthiYadavalli","name":"sryadava","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isOwner":false,"isOrgMember":false},"createdAt":"2024-03-04T05:39:00.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"@ybelkada ,\n\nThen we have to modify the code and update it for mac users. Can I raise a pull request for the same?","html":"\n\n@ybelkada\n\t ,
\nThen we have to modify the code and update it for mac users. Can I raise a pull request for the same?
\n","updatedAt":"2024-03-04T05:39:00.818Z","author":{"_id":"65e1eaae60db3642556c588c","avatarUrl":"/avatars/784579216b80a3f60c07ab6878e29b5d.svg","fullname":"SreeSindhuSruthiYadavalli","name":"sryadava","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8225404024124146},"editors":["sryadava"],"editorAvatarUrls":["/avatars/784579216b80a3f60c07ab6878e29b5d.svg"],"reactions":[],"isReport":false}},{"id":"65e56dc8edc2f7306ed5f6ac","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503,"isOwner":false,"isOrgMember":false},"createdAt":"2024-03-04T06:44:24.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"yes feel free to do so and ping me for a review!","html":"yes feel free to do so and ping me for a review!
\n","updatedAt":"2024-03-04T06:44:24.698Z","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8987091183662415},"editors":["ybelkada"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png"],"reactions":[],"isReport":false}}],"pinned":false,"locked":false,"collection":"discussions","isPullRequest":false,"isReport":false},"primaryEmailConfirmed":false,"repo":{"name":"google/gemma-7b","type":"model"},"discussionRole":0,"acceptLanguages":["*"],"hideComments":true,"repoDiscussionsLocked":false,"isDiscussionAuthor":false}">Hi,
For the example of A script to perform Supervised Fine-Tuning (SFT) on UltraChat dataset using QLoRA
, the quantization won't work on mac silicon devices.
If that is expected can we update the code accordingly that helps us to do enough modifications to the code.
yes feel free to do so and ping me for a review!