Due to recent work on the IDA, the current specification is not as stringent as the current IDA implementation. The 'User Agent' header is required by the IDA implementation, but not listed in the specification.
If may be that the HTTP spec requires the header, but I don't think so.