Sandip,
tcode ST22 in ECC is a good place to start. On your assumption if oData query is already optimized to the fullest , pagination is one way, though not a perfect solution as pagination still runs the whole query and then drops the records before sending to gateway handlers.
Some more things to do, check your table indexes , limit the queries by selections etc - might be put some date restrictions etc.
Regards,
Ram.