Moodle

auth/db implementation for syncing users consumes much memory if you have lots of users.

Details

  • Type: Improvement Improvement
  • Status: Open Open
  • Priority: Major Major
  • Resolution: Unresolved
  • Affects Version/s: 1.8.2
  • Fix Version/s: DEV backlog
  • Component/s: Authentication
  • Labels:
  • Environment:
    Linux/Mysql/Oracle
  • Database:
    MySQL, Oracle
  • Affected Branches:
    MOODLE_18_STABLE

Description

The current auth/db implementation for syncing users is a memory hog if you have lots of users. We should use the same technique auth/ldap does: using a temporary user table and doing things from the database instead of from moodle.

Issue Links

This issue has a non-specific relationship to:
MDL-25372 Use temporary tables in sync_users of external database authentication Minor Open

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Angelo Rigo added a comment -

This proccess takes the risk of data loss if the LAN connections are weak or break.

Show
Angelo Rigo added a comment - This proccess takes the risk of data loss if the LAN connections are weak or break.
Hide
Permalink
Angelo Rigo added a comment -

Using array_push is necessary? can´t $variable[] = $extcourse .... have the same effect ? i see reports showing that array_push is more resource intensive than using $variable[] = $extcourse; . Using $variable[] = $extcourse; could cut the intensive use of memory .

The last check seeing if moodle have any course that the external db does not use the not in clause wich is more resource intensive than a loop for one single course at time.

Show
Angelo Rigo added a comment - Using array_push is necessary? can´t $variable[] = $extcourse .... have the same effect ? i see reports showing that array_push is more resource intensive than using $variable[] = $extcourse; . Using $variable[] = $extcourse; could cut the intensive use of memory . The last check seeing if moodle have any course that the external db does not use the not in clause wich is more resource intensive than a loop for one single course at time.
Hide
Permalink
Daniel Neis added a comment -

I am trying to get better performance implementing the process with temporary tables like what is done in ldap. Please take a look at MDL-25372

Show
Daniel Neis added a comment - I am trying to get better performance implementing the process with temporary tables like what is done in ldap. Please take a look at MDL-25372

People

Vote (4)
Watch (2)

Dates

  • Created:
    Updated:
Atlassian JIRA (v4.4.3#663-r165197) | Report a problem
Powered by a free Atlassian JIRA open source license for Moodle. Try JIRA - bug tracking software for your team.