What type of project? If it's gradle, what version of Gradle? And where are you setting the arguments? In the Gradle Build options, or is this being run via "Debug -> Start with arguments..."?
My first suspicion was gradle 4.9 or above, since that uses the new feature for passing command line arguments, but that seems to work for me.