You hit the nail on the head. What we can't see with level II is the block trades over 10k shares. MM don't have to show trades of 10K shares or greater - only the traders see them. Therefore, there could be a large trade out there that is slowly getting filled.
The big boys control 80% of the market. They move the stock, not us.