Today we found an issue with our SLM8 server where the C: appears to be filling up with Chunk files. Has anyone else come across this? File location is C:\ProgramData\SnowSoftware\LicenseManager\EventStore\Database\
Looking at the date of the files this started happening back in June 2017, we now have 11GB's worth of them. I have just logged a ticket with Snow support to find out what these are.
Hi Carola,
Thanks for your response on this. I am assuming this issue is not fixed with the update 8.2.05 as the latest file seems to constantly updating. I will wait for Support to come back to me, but it is good to know there is a work around for this problem.
Hi Corola, we now also run into this issue while running SLM 8.3.3. Last week I created a ticket for this too which is still at status new... But I'm thinking of following your tip about data move + config change + service restart since that worked for you.
But what happens when Snow server modules get updated by SUS or manually? Is the config not overwritten so losing your changes?
Thanks for your response,
Gert-Jan.
Hi Gert-Jan,
First of all, the settings I made to change EventStore to E: were not overwritten by normal SUS updates.
So that's not the problem.
But meanwhile Snow also implemented an Enterprise Agreement Service, that also stores data in a database with chunkfiles. For that database I was not successful to change the drive.
In my ticket I got last week the information that this issue is planned to be solved with 9.0.1.
And if critical additionally another workaround would be possible to reduce the chunkfile size.
I will have a webex today to clarify this :-)
Hi Carola,
thanks for your quick reply.
I just got a reply from Snow Support on my ticket as well and I was indeed asked if we are utilizing the Software Enterprise Agreement Service and Event store Service? On which our answer is Yes. Which means this ticket will be escalated onto the Global team. So from different customers the 'pressure' is on now
I will keep you updated.
regards,
Gert-Jan.
Hi gert-jan.kosterman@dllgroup.com
Yesterday I had a webex with Global support, and got the information the Software Enterprise Agreement Service is not necessary at the moment and was implemented for the future. So we stopped that service and set it to Manual start. Therefore now this database will not increase any more and the files can be removed. But I don't know when that service will be necessary again.
Event Store database is required for O365 history. As mentioned we have moved this database to E:, here we at the moment have enough space. But if you are running out of disk space, support also has a possibility to shrink / scavenge that files until SLM 9.0.1 will be released.
Hi Carola,
Snow support is requesting me for some chunk files (262MB per file...) but because of security/privacy reasons I'm not able to provide those to them.
So I will go for the workarounds you described: stop the Enterprise service an remove the corresponding chunk files. And the other: move the O365 related chunk files to another drive and change the config corresponding and stop/start the corresponding services.
I hope that will do for some time.
Thanks again for your sharing the workarounds,
Gert-Jan.
Hi Carola,
today with help of Snow support we did scavenge the EventStore on our PRD, ACC and TST environment. This resulted in an extra 10GB of free diskspace on the C: drives. Which is good.
kind regards,
Gert-Jan.
I forgot, after changing the config you need to restart the service Snow License Manager Event Store Service.
And as I checked my environment this morning, I saw I have less chunk files than before. Perhaps now old files will be removed during the DUJ ?
Hey Benn and Carola,
During the 8.2.5 release we made changes to how the eventstore database was storing the Office 365 data (these are the chunks you are referring to).
This should have reduced both the overall size of the evenstore database and how quickly it grows with data overtime.
Keep in mind that the chunks will keep changing based on the Office 365 data you import to the system, and any cost/user linking/etc functionality that you use related to Office 365. This is expected behavior.
If you are still seeing a large event-store folder (keep in mind this is relative to the amount of office 365 data you are importing) after then 8.2.5 release, please contact support.
Let me know if this answers your question.
Hi Tom,
Thank you for your explanation. I'm in contact with support.
So I understand, that DUJ or any other job will not remove old files?
I will observe this for a while to see how the files are growing. During the last days it unfortunately looked like they are growing in the same way as before. One file in 4-5 days.
Hey Carola,
Ok keep in touch with Support regarding the size (we are storing the historical data, so it will grow, however we should look at the rate and check that it makes sense).
Right now the historic data is not being cleared, we are investigating how much history we think should be kept (our current thinking is somewhere between one and three years, but we need to dig into this further). We are also looking at if this should be configurable, or be tied to existing history settings.
FYI the office connector data is technically separated from the DUJ, so there is no relationship there (only in terms of the data we then link to using user linking).
Hi,
For Snow Customers not using the Office 365 Connector only!
We were given a fix by the Snow Support team for chunk files creation issue.
You need to logon to the SLM server and disable the following services. Snow License Manager Event Store Service and the Snow License Manager Office 365 Service. You can then delete the Chunk files that are taking up space on the disk.
Hi all,
Meanwhile I got the information that this was solved with SLM 8.3.4
I watched this for a while and can confirm, that now only less chunk-files exist. (3 in our environment)
So for me this looks good now
Hi Carola, thanks for the update.
We have a mixture of different numbers of chunk files in our environment:
TST (SLM 8.3.05): 4 chunk files
PRD (SLM 8.3.04): 5 chunk files
ACC (SLM 8.3.04): 6 chunk files
I will monitor this more closely and see what happens.
Hi Benn,
These chunk files are for Snow's Eventstore, that is used for Office 365.
I also have experienced this and already created a ticket at Snow, that this database is filling the disk.
Today I got an answer, that this should be solved with 8.2.05.
But I don't know, if only from now on with 8.2.05 the files will not increase so quick and so much.
I don't know what will happen to the old files.
As workaround before 8.2.05, support told me I can move the eventstore to another disk and I also can compress the files.
To move eventstore to another disk you need to change following parameter in C:\Program Files\Snow Software\Snow License Manager\Services\EventStore\SnowSoftware.LicenseManager.EventStore.Service.exe.config
I set the path to E:
<add key="CustomDbPath" value="E:\SnowSoftware\LicenseManager\EventStore\Database" />
But perhaps with 8.2.05 this is not necessary any more.