T O P

  • By -

Sand-Discombobulated

where do you download the GGUF of gemma? When I go to the Kaggle Gemma page, I see 'model variations: Keras, PyToirch, Transformers, Gemma C++, Tensor, MaxText, Pax, Flax. for Keras it extracts to: model.weights.h5 - 16GB file. - this file does not open in LM Tools.


puffyarizona

[https://huggingface.co/lmstudio-ai/gemma-2b-it-GGUF/tree/main](https://huggingface.co/lmstudio-ai/gemma-2b-it-GGUF/tree/main)


[deleted]

Thanks!!


Ill_Assignment_2798

How censored ?


Money_Business9902

very


Ilforte

What's the prompt template you are using? The one recommended by Google?


Internet--Traveller

Is it as woke as it's twin - Gemini?


Flopsinator

Lmao, woke = censored? Or is woke just anything you don't like?


Internet--Traveller

Gemini = Sony Wokeman™


AbsoluteHedonn

I can’t wait for you all to die off, fucking boomers


Internet--Traveller

So much anger. Play some Wokemon™ - go catch them al!


Money_Business9902

Its surprisingly quick in responding, even quicker than tinyllama 1.1B model. How is this possible?


50tonred

it uses grouped query attention, like Mistral.