If it is of any help, I am deep into AI in the last 2 years and I still can’t understand most Hugging Face projects. But I think that’s ok: I also don’t understand most of what is on GitHub, except for things written in certain languages, like Elixir or Erlang.
Therefore, the book will give you similar context. It is unlikely you will fully grasp any Hugging Face model, but there are certain models, architectures, and problems that will make a lot more sense once you read it.
Unfortunately there is no quantization at the moment but we are working on it. You can fine-tune models and one of the chapters discuss it, but you will most likely need a GPU and that’s one particular area we want to further improve the UX on.