lynx   »   [go: up one dir, main page]

@sryadava\n\t
Yes it is expected, bitsandbytes is not supported on MacOS devices

\n","updatedAt":"2024-03-04T00:52:40.338Z","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8596454858779907},"editors":["ybelkada"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png"],"reactions":[],"isReport":false}},{"id":"65e55e74a0681de6302333a3","author":{"_id":"65e1eaae60db3642556c588c","avatarUrl":"/avatars/784579216b80a3f60c07ab6878e29b5d.svg","fullname":"SreeSindhuSruthiYadavalli","name":"sryadava","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isOwner":false,"isOrgMember":false},"createdAt":"2024-03-04T05:39:00.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"@ybelkada ,\n\nThen we have to modify the code and update it for mac users. Can I raise a pull request for the same?","html":"

\n\n@ybelkada\n\t ,

\n

Then we have to modify the code and update it for mac users. Can I raise a pull request for the same?

\n","updatedAt":"2024-03-04T05:39:00.818Z","author":{"_id":"65e1eaae60db3642556c588c","avatarUrl":"/avatars/784579216b80a3f60c07ab6878e29b5d.svg","fullname":"SreeSindhuSruthiYadavalli","name":"sryadava","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8225404024124146},"editors":["sryadava"],"editorAvatarUrls":["/avatars/784579216b80a3f60c07ab6878e29b5d.svg"],"reactions":[],"isReport":false}},{"id":"65e56dc8edc2f7306ed5f6ac","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503,"isOwner":false,"isOrgMember":false},"createdAt":"2024-03-04T06:44:24.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"yes feel free to do so and ping me for a review!","html":"

yes feel free to do so and ping me for a review!

\n","updatedAt":"2024-03-04T06:44:24.698Z","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8987091183662415},"editors":["ybelkada"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png"],"reactions":[],"isReport":false}}],"pinned":false,"locked":false,"collection":"discussions","isPullRequest":false,"isReport":false},"repo":{"name":"google/gemma-7b","type":"model"},"activeTab":"discussion","discussionRole":0,"watched":false,"muted":false,"repoDiscussionsLocked":false}">

quantization won't work on mac silicon devices

#55
by sryadava - opened
@sryadava\n\t
Yes it is expected, bitsandbytes is not supported on MacOS devices

\n","updatedAt":"2024-03-04T00:52:40.338Z","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8596454858779907},"editors":["ybelkada"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png"],"reactions":[],"isReport":false}},{"id":"65e55e74a0681de6302333a3","author":{"_id":"65e1eaae60db3642556c588c","avatarUrl":"/avatars/784579216b80a3f60c07ab6878e29b5d.svg","fullname":"SreeSindhuSruthiYadavalli","name":"sryadava","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"isOwner":false,"isOrgMember":false},"createdAt":"2024-03-04T05:39:00.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"@ybelkada ,\n\nThen we have to modify the code and update it for mac users. Can I raise a pull request for the same?","html":"

\n\n@ybelkada\n\t ,

\n

Then we have to modify the code and update it for mac users. Can I raise a pull request for the same?

\n","updatedAt":"2024-03-04T05:39:00.818Z","author":{"_id":"65e1eaae60db3642556c588c","avatarUrl":"/avatars/784579216b80a3f60c07ab6878e29b5d.svg","fullname":"SreeSindhuSruthiYadavalli","name":"sryadava","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8225404024124146},"editors":["sryadava"],"editorAvatarUrls":["/avatars/784579216b80a3f60c07ab6878e29b5d.svg"],"reactions":[],"isReport":false}},{"id":"65e56dc8edc2f7306ed5f6ac","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503,"isOwner":false,"isOrgMember":false},"createdAt":"2024-03-04T06:44:24.000Z","type":"comment","data":{"edited":false,"hidden":false,"latest":{"raw":"yes feel free to do so and ping me for a review!","html":"

yes feel free to do so and ping me for a review!

\n","updatedAt":"2024-03-04T06:44:24.698Z","author":{"_id":"62441d1d9fdefb55a0b7d12c","avatarUrl":"https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png","fullname":"Younes B","name":"ybelkada","type":"user","isPro":false,"isHf":false,"isHfAdmin":false,"isMod":false,"followerCount":503}},"numEdits":0,"identifiedLanguage":{"language":"en","probability":0.8987091183662415},"editors":["ybelkada"],"editorAvatarUrls":["https://cdn-avatars.huggingface.co/v1/production/uploads/1648631057413-noauth.png"],"reactions":[],"isReport":false}}],"pinned":false,"locked":false,"collection":"discussions","isPullRequest":false,"isReport":false},"primaryEmailConfirmed":false,"repo":{"name":"google/gemma-7b","type":"model"},"discussionRole":0,"acceptLanguages":["*"],"hideComments":true,"repoDiscussionsLocked":false,"isDiscussionAuthor":false}">

Hi,

For the example of A script to perform Supervised Fine-Tuning (SFT) on UltraChat dataset using QLoRA , the quantization won't work on mac silicon devices.
If that is expected can we update the code accordingly that helps us to do enough modifications to the code.

Hi @sryadava
Yes it is expected, bitsandbytes is not supported on MacOS devices

@ybelkada ,

Then we have to modify the code and update it for mac users. Can I raise a pull request for the same?

yes feel free to do so and ping me for a review!

Sign up or log in to comment

Лучший частный хостинг