Best Approach for Validating Thousands of Inputs in an Elixir SDK Project

I’d come back and give you a more concrete response but for now I’d say avoid dynamic solutions as a matter of principle. You should prioritize writing code that would be painfully obvious to your future self a year later. That should override all other considerations. If that means the code gets to be more verbose and live in more files – so be it.

Additionally, you can code up a central router / dispatcher that “guesses” which service is the input meant for, by having multiple-headed pattern-matching function clauses – but that’s optional and it could backfire. If the clients are explicitly identifying the data they are sending and whom are they intended for (via an extra input piece of data in their request to your server) then you’re better off using that.

Doing additional validation on every request seems like the more-likely cause of overhead since presumably you’re expecting substantially more correct requests than malformed ones.

In any case, consider JSON Schema if you need to validate a bunch of different JSON shapes; if you’re lucky, the API may already publish one.

thank you so much for sharing your insights and perspectives about maintaining a well-defined codebase.

Regarding your suggestion about a general router, I believe it might not be necessary given how I’m planning to organize the SDK operations. Each operation will have its own dedicated function within the Client module (SDK.CLIENT.operation) to match different API endpoints. This way, pattern matching/validation can be performed at the operation level, e.g:

<SDK>.VirtualMachine.create_instance(…, %CreateInstanceInput{}, …) 
<SDK>.VirtualMachine.attach_disk(…, %AttachDiskInput{}, …) 
<SDK>.Log.search_logs(…,%SearchLogsInput{}, …)```

thank you so much for the reply! I totally get your point, and it makes a lot of sense.

That being said, I still believe client-side validations are valuable for this SDK. Not only will they prevent unnecessary API calls, but they’ll also allow me to provide more user-friendly error messages compared to the current API responses. I believe this will make the SDK more developer-friendly and help users avoid headaches.

I’ll explore the JSON schema options, they seem like they could be a great fit, thanks!