Answering my own question, got it working by going to Extensions → Tailwind → Settings and add elixir->html mapping
elixir->html