Is there a way to view the difference between actuals and scheduled hours grouped by project in reports?

No, in Reports, you can only view Difference (the difference between actuals and scheduled hours) grouped by person or other person-based parameters from the People Variance Report.

To view the difference per project, you can visit the Performance Dashboard in Insights.