Mass publishing in SDL Web 8.5 and SDL Tridion Sites 9.0 leads to slow throughput and the Deployer endpoint deadlocking
000011336|11/8/2019 10:53 PM
SDL Web 8.5, SDL Tridion Sites 9.0
In either SDL Web 8.5 or SDL Tridion Sites 9.0, mass publishing can lead to State Store database deadlocks and errors/failures removing rows from the State Store DB. Errors as such are seen in the Deployer logs (either a combined Deployer or a scaled out Deployer and the errors will then show in the Endpoint):
ERROR SqlExceptionHelper - Transaction (Process ID 100) was deadlocked on lock resources with another process and has been chosen as the deadlock victim. Rerun the transaction.
ERROR [dispatcherServlet] - Servlet.service() for servlet [dispatcherServlet] in context with path  threw exception [Request processing failed; nested exception is org.springframework.dao.CannotAcquireLockException: could not execute statement; SQL [n/a]; nested exception is org.hibernate.exception.LockAcquisitionException: could not execute statement] with root cause
Errors on removing rows from the State Store DB:
ERROR [dispatcherServlet] - Servlet.service() for servlet [dispatcherServlet] in context with path  threw exception [Request processing failed; nested exception is org.springframework.web.multipart.MultipartException: Could not parse multipart servlet request; nested exception is java.io.IOException: org.apache.tomcat.util.http.fileupload.FileUploadBase$IOFileUploadException: Processing of multipart/form-data request failed. No space left on device] with root cause
Several sub-optimal actions on the endpoint processes for the Deployer.
A hotfix is available in SDL Web 8.5 and SDL Tridion Sites 9.0 to make improvements to the endpoint behavior and in turn stabilize mass publishing success rates and better the overall throughput. Throughput is still highly dependent on available resources and publishing use cases. So the hotfix does not preclude from doing performance testing and tuning of the various available configurations in the Deployer, Transport Service, and Publisher.