What is difference between stateful and stateless in batch class in Salesforce?

Batch Apex is stateless by default. That means for each execution of your execute method, you receive a fresh copy of your object. If your batch process needs information that is shared across transactions, one approach is to make the Batch Apex class itself stateful by implementing the Stateful interface.