Can I really build a grocery app for under $25,000?

Yes, if you keep it to one store, one payment method, and no live tracking. A simple app can focus on product browsing, ordering, checkout, and basic order status updates.