Is it possible to use it on Android?
#5
by
tinnystudios
- opened
Hi guys,
I need to build an application on Android. It has the following requirements.
- Use LLAMA locally.
- The app will be consumer facing so I can't expect them to install Termux.
- Has Vision.
Apologies for the question, I'm unable to find any resource around this. Is this possible?
I'm not leafspark, and I'm pretty new to this, but I'm guessing that this model would not be a good fit for a android phone with a small amount of RAM. Even though it's quantized it's still relatively large. For example Q4_K_M.gguf is around 6GB in size.