Which object is the rule running on? This is likely cycling through all of the objects that meet the criteria and running the report for each one.
Have you tried going to the report itself and setting up a schedule there as opposed to using a workflow rule?