Re: Ongoing architecture work


Hi all!

On 10/08/2014 11:13 AM, Matthew Turk wrote:
>  * Analysis launching (Kacper, feel free to share about this)

as Matt already mentioned we've been working on a remote analysis
framework. The idea behind it is to use dedicated docker[1] containers
that can be dynamically spawned closely to data itself. The fact that we
are using virtualized environment allows to easily switch underlying
analysis software. Whole process: launching python script in docker
container, monitoring job status, obtaining results, is wrapped in
lightweight microservices exposing REST API. This allows for easy cml
tools creation, as well as integrating with more sophisticated web
services (like the dashboard that Ian's working on).

Cheers,
Kacper

[1] https://www.docker.com/whatisdocker/


Attachment: signature.asc
Description: OpenPGP digital signature



Other Mailing lists | Author Index | Date Index | Subject Index | Thread Index