You do not need to uninstall the extensions before updating them. In fact, by uninstalling them, you will lose all configurations (module instances...).
Before updating, make sure you read the change logs and are aware of potential backward compatibility issues.
Moving to Joomla 5 from Joomla 4.4
The upgrade is seamless and no side effects have been reported so far. If you have the latest version installed under Joomla 4.4, no update is necessary when upgrading to Joomla 5.
The extension works properly with the Compatibility plugin enabled.
More testing is needed on sites where the Compatibility plugin is disabled.
Moving to Joomla 4 from Joomla 3.10
For a successful migration to Joomla 4, the extension first needs to be up to date in your Joomla 3.10 configuration.
For general instructions on moving from Joomla 3.10 to Joomla 4, please check this tutorial out!
Must read: specific instructions about the migration for this extension.