To post a new support question, click the Post New Topic button below.
Current Version: 5.3.4 | Sytist Manual | Common Issues | Feature Requests
Please log in or Create an account to post or reply to topics.
You will still receive notifications of replies to topics you are part of even if you do not subscribe to new topic emails.
Cloud Storage Vs Inodes
B
Benoit Champagne
59 posts
Mon Feb 07, 22 4:07 PM CST
HI Tim,
I was wondering about the mechanism when an offsite storage is used (as S3 for example). In particular, are any Inodes / files used for each files offloaded ?
Let me give you an overview of where I am going with this and another question will follow that.
I might have a situation where I would have more than 600,000 images to put in a gallery where people (approx 30k, 35k persons total) will be able to search and download their images.
So, as you can see, I have some scalability concerns here.
Would Sytist be able to scale to that level ?
Are there any limits on a gallery size ?
I know the files can be moved to the cloud when uploading them. But is that process scalable to that level ?
Any suggestion to help in preparing for this would be great as well. I am also looking at ways to incorporate Facial recognition into my system. Have you ever looked at this feature before for Sytist ?
Thanks for your help & time.
Best regards,
Benoit
I was wondering about the mechanism when an offsite storage is used (as S3 for example). In particular, are any Inodes / files used for each files offloaded ?
Let me give you an overview of where I am going with this and another question will follow that.
I might have a situation where I would have more than 600,000 images to put in a gallery where people (approx 30k, 35k persons total) will be able to search and download their images.
So, as you can see, I have some scalability concerns here.
Would Sytist be able to scale to that level ?
Are there any limits on a gallery size ?
I know the files can be moved to the cloud when uploading them. But is that process scalable to that level ?
Any suggestion to help in preparing for this would be great as well. I am also looking at ways to incorporate Facial recognition into my system. Have you ever looked at this feature before for Sytist ?
Thanks for your help & time.
Best regards,
Benoit
V
Vance Birno
301 posts
Mon Feb 07, 22 5:06 PM CST
Love to know what you are shooting to get 600,000 images. But even if you could upload 1 image per second every second, it would take 166.666667 hours to up load that many in one session, or is this over several events?
B
Benoit Champagne
59 posts
Mon Feb 07, 22 7:18 PM CST
Hi Vance,
Well, do the math ;). If you cover a major International Marathon with 25k to 40k runners, with 10 to 15 photographers each trying to shoot close to 2-3 frames per runners, you end up with over a million picture quite fast. Not saying it's the case in the above question, but I do cover such events and the one I'm referring to is pretty close to those numbers as well. All in one day and pictures are available and indexed with 24 to 36 hours :) !
Regards
Well, do the math ;). If you cover a major International Marathon with 25k to 40k runners, with 10 to 15 photographers each trying to shoot close to 2-3 frames per runners, you end up with over a million picture quite fast. Not saying it's the case in the above question, but I do cover such events and the one I'm referring to is pretty close to those numbers as well. All in one day and pictures are available and indexed with 24 to 36 hours :) !
Regards
Tim - PicturesPro.com
17,108 posts
(admin)
Wed Feb 09, 22 5:46 AM CST
There are 4-5 files for each photo you upload. When using S3 they are all moved to S3.
I have seen over a million photos in a Sytist site, not sure on how many in a certain gallery.
I have seen over a million photos in a Sytist site, not sure on how many in a certain gallery.
Tim Grissett, DIA - PicturesPro.com
My Email Address: info@picturespro.com
My Email Address: info@picturespro.com
T
Trailboy
444 posts
Wed Feb 09, 22 6:01 AM CST
"seen over a million photos in a Sytist site"
That's good to know.
Was the site was still responsive searching that many images? Would using passcodes affect the responsiveness with a sytist site using that number of images?
That's good to know.
Was the site was still responsive searching that many images? Would using passcodes affect the responsiveness with a sytist site using that number of images?
Edited Thu Feb 10, 22 5:31 AM by Trailboy
B
Benoit Champagne
59 posts
Wed Feb 09, 22 6:11 AM CST
Thanks Tim for the precisions. It helps in my planing.
Trailboy, the way I see it, the search for files will be bound by the database much more than the file system. MYSQL should scale to these levels since many DB use much more data than this. At least, I think. I've worked with may other database systems in the past (at low level and in real time entreprise systems) and scalability is pretty much good usually. Of course, it becomes much more CPU intensive though.
Regards.
Trailboy, the way I see it, the search for files will be bound by the database much more than the file system. MYSQL should scale to these levels since many DB use much more data than this. At least, I think. I've worked with may other database systems in the past (at low level and in real time entreprise systems) and scalability is pretty much good usually. Of course, it becomes much more CPU intensive though.
Regards.
Please log in or Create an account to post or reply to topics.

Loading more pages