cyrildiagne / ar-cutpaste, Hacker News

An AR ML prototype that allows cutting elements from your surroundings and pasting them in an image editing software.

Although only Photoshop is being handled currently, it may handle different outputs in the future.

Demo & more infos: Thread

⚠️ This is a research prototype and not a consumer / photoshop user tool.

(Modules)

This prototype runs as 3 independent modules:

1 – Configure Photoshop

Go to “Preferences> Plug-ins”, enable “Remote Connection” and set a friendly password that you’ll need later.

2 – Setup the external salience object detection service

As mentioned above, for the time being, you must deploy the BASNet model (Qin & al, CVPR 2019 as an external HTTP service using this BASNet-HTTP wrapper (requires a CUDA GPU)

You will need the deployed service URL to configure the local server

3 – Configure and run the local server

follow the instructions in / server to setup & run the local server.

, 4 – Configure and run the mobile app follow the instructions in / app to setup & deploy the mobile app.

Thanks and Acknowledgments

(BASNet code for ‘ (BASNet: Boundary-Aware Salient Object Detection) (code ‘, (Xuebin Qin ,

Zichen Zhang , Chenyang Huang , (Chao Gao , Masood Dehghan and Martin Jagersand RunwayML for the Photoshop paste code