Anyone have an object storage API they like?
The S3 API is an unfortunate de facto API for object storage. S3’s dominance required competitors to replicate its API for drop-in compatibility, further proliferating its suboptimal design.
Recent searches
Search options
#s3
4 posts4 participants0 posts today
The #data team I lead for the #Australian Plant Phenomics Network (https://plantphenomics.org/) is seeking two additional #Python #developers as part of our efforts to build end-to-end pipelines for #FAIR #research data.
One will focus on interfaces between our nodes and #S3 #repository storage at #Pawsey and #NCI.
The other will build tools to help nodes package complex data using RO-Crate.
The preferred location is Adelaide.
https://careers.adelaide.edu.au/cw/en/job/516522/appn-software-engineer-repository-services
https://careers.adelaide.edu.au/cw/en/job/516408/appn-software-engineer-data-packaging
Please boost.
Australian Plant Phenomics NetworkHomeAPPN is Australia’s network of National Research Infrastructures for plant and agricultural science.
arc) TIL you can use torrents to seed+distribute s3 files. I wonder if anyone has written the reverse, an s3 frontend backed by torrents. That strikes me as useful for fedi media caching 
(though perhaps the deduplication of hashes/IPFS would suit better)
https://carltonbale.com/how-to-create-and-seed-a-torrent-download-on-amazon-s3/
carltonbale.comHow to Create and Seed a Torrent Download on Amazon S3 – Carlton Bale
The #norwegian public transport organisation #vy closed a #s3 #bucket with more than 50k reports about how their bus drivers perform in therms of efficiency, comfort and so on. The system is called "Eco Safe".
A litte description of this system is here: https://ytf.no/nyheter/gronn-overvakning
Quotes: orig: "Vi tillitsvalgte har full kontroll på hvem som får tilgang til forskjellige opplysninger og hvordan de brukes." engl translation: "We union representatives have full control over who gets access to different information and how it is used." This was not accurate until a few hours ago.
Feel like I really not updating a lot of my old project but today is the day I do!
finally updated my fork of imgs (A simple image sharing platform) imgp to support account, image management and API creation besides the original S3 storage modification
Tonight I found a #s3 #bucket with backups of 106 unique #Wordpress instances of doctors, freelancers and other SMB from #uk .
The company owning the bucket claims to provide secure cloud infrastructure. I have my doubts. 
Continued thread
Continued thread
"It's five grand a day to miss our S3 exit"
https://world.hey.com/dhh/it-s-five-grand-a-day-to-miss-our-s3-exit-b8293563
world.hey.comIt's five grand a day to miss our S3 exitWe're spending just shy of $1.5 million/year on AWS S3 at the moment to host files for Basecamp, HEY, and everything else. The only way we were able to get the pricing that low was by signing a four-year contract. That contract expires this summer, June 30, so that's our departure date for the final leg of our cloud exit. We've already...
two days ago a #s3 bucket containing a SQL dump with data from #volkswagen #financial #services was deleted. I reported the bucket on the 9th of March, so it took them close to three weeks to fix it.
My mail with the responsible disclosure to #vw was never answered or acknowledged.
Continued thread
2/10
Mal fährt die #S3, mal die #S5. Dann kommt plötzlich die S1 nach #Poppenbüttel. Oder die S2. Oder eine Bahn zum #Flughafen. Alles auf demselben Gleis. Es gibt keinen zuverlässigen Plan. #S-BahnHamburg #Barrierefreiheit #EinfacheSprache
I'm looking for #data on #CloudStorage providers, in an effort to:
a) sort out where I put my #backups, and
b) not trawl the internet to aggregate this data myself!
I'm looking for basic info (pricing; access protocols; hosting locations; data sovereignty), and also facts about the provider such as public/private ownership, tax residency, and ultimate beneficial ownership.
I'm more than happy to glue disparate datasets together: do you have any pointers? #opendata #storage #s3 #rclone #restic
Streamlining access to tabular datasets stored in Amazon S3 Tables with DuckDB | AWS Storage Blog
Amazon Web Services · Streamlining access to tabular datasets stored in Amazon S3 Tables with DuckDB | Amazon Web ServicesAs businesses continue to rely on data-driven decision-making, there’s an increasing demand for tools that streamline and accelerate the process of data analysis. Efficiency and simplicity in application architecture can serve as a competitive edge when driving high-stakes decisions. Developers are seeking lightweight, flexible tools that seamlessly integrate with their existing application stack, specifically solutions […]
Thanks to @camwilson, @masek & Crikey for bringing the SMH/AFR subscriber S3 bucket breach into light and getting it fixed.
First announced at https://infosec.exchange/@bucketchallenge/114186026451954362
#crikey:
> Last year, Nine bragged about having first-party data including “demographic, content consumption and behavioural information” on 22 million users, and combining that with third party data, to create “rich, detailed, real-time profiles of audience members”.
Infosec Exchangebucketchallenge (@bucketchallenge@infosec.exchange)Tonight I found a #s3 #bucket from down under upside down and open. It spills a lot of jucy customer data including names, addresses and email IDs.
The responsible disclosure was just sent to the company "owning" the data, but I guess this is the work of some sub contractor. I kindly asked for updates, otherwise I'll escalate that bucket to other agencies to make it go offline.
Express-S-Bahn auf der S3 in Berlin kommt zurück
#Bahn #Bauarbeiten #Berlin #DeutscheBahn #Erkner #Express #ExpressSBahn #Friedrichshagen #Karlshorst #Köpenick #Ostbahnhof #SBahn #S3
https://bahnblogstelle.com/230410/express-s-bahn-auf-der-s3-in-berlin-kommt-zurueck/
Since last week trying to snapshot elastic search into minio.
Not sure whether the problem is elasticsearch or minio, which is hosted by cloud provider.
Tomorrow I will install local VM to try things further.