phx-click messes up the evnets for native html element

When I add an event to my Collapsible (this is a simplified version) it will not toggle the details / summary. I think it has something to do with liveview hijacking the event, but is there something im missing?

      <details>
        <summary>
          <div phx-click="toggle_event" >
            <span>
              This does not work due to the phx-click
            </span>
          </div>
        </summary>
        The hidden content
      </details>

      <details>
        <summary>
          <div>
            <span>
              This one works as expected without the phx-click event
            </span>
          </div>
        </summary>
        The hidden content
      </details>

I should add that it works fine when adding an onclick in plain html