In digging deeper, this seems to happen only when Akismet support is enabled.
When Akismet is disabled, the correct Kunena "need a subject" and "need a message" error messages are shown.
Can checking Akismet be fixed so that it only happens after the Kunena validation?