Would I get arrested for this?

If you do not have a licensed driver with you, you will get a ticket if stopped. Chances are the car will be impounded also . A cop might give you a break on the stolen car part. But, to violate the terms of your learner's permit courting trouble.