-
Improvement
-
Resolution: Fixed
-
Major
-
2.1.7, 2.2.4, 2.3.1, 2.6.3, 2.7
-
MOODLE_21_STABLE, MOODLE_22_STABLE, MOODLE_23_STABLE, MOODLE_26_STABLE, MOODLE_27_STABLE
-
MOODLE_29_STABLE
-
MDL-34867-master -
-
BACKEND Sprint 18
Exporting to various formats from the course log report is excessively resource intensive, often failing due to various limits:
- The ODS exporter consumes all memory until hitting the limit
- The Excel exporter in particular uses all CPU until time limit reached
- All exporters utilise get_logs which will hit memory limit for many records
- Main loop for all exporters makes 1 query for each log entry - slow and unnecessary DB load
- Queries are made with strings for an id number field
With some profile guidance I have reworked the critical paths somewhat to improve this situation.
The main bottleneck remaining the Excel and ODS exporters which probably need a more through revisit to really solve this.
- blocks
-
MDL-34925 Improve bulk user export performance
- Closed
- caused a regression
-
MDL-49162 report_log Event context link not working after MDL-34867
- Closed
-
MDL-48729 Prevent fatal error if retrieving legacy log data fails
- Closed
- has a non-specific relationship to
-
MDL-33337 META: RFC-4180 CSV file compliance for greater portablility of exported data.
- Closed
-
MDL-47454 Add $logextra parameter to restore_legacy() in base event class
- Closed
- has been marked as being related by
-
MDL-48595 Log exports still consume all memory and fail
- Closed
-
MDL-50390 Logs download (e.g. CSV) uses too much server memory
- Closed
-
MDL-48702 Improve course log export resource consumption and reliability (backport of MDL-34867)
- Closed
- is duplicated by
-
MDL-40094 Download of large course or site log report results in out of memory error
- Closed
- will help resolve
-
MDL-30212 Out of memory error on logs reports
- Reopened
-
MDL-32966 Can't view front page course report log on a large site
- Closed
-
MDL-46626 Log report export contains html
- Closed
-
MDL-48595 Log exports still consume all memory and fail
- Closed