The concern is that Dalvik will further fragment the Java language, making it more difficult for programmers to code to a common language and set of APIs. This despite the fact that Google has at least assured that Android won't become all forked up.
Discussion (1)
Android fragments the Java language much less than J2ME IMHO. It does however further fragment the mobile OS market.