Artificial intelligence, the new tool to create horror and erotic images

From the beginning, OpenAi has limited access to its image generators, by inserting a filter that limits requests. It is the same approach underlying a competing service, Midjourneywhich was launched in July of this year and has helped increase the popularity of AI artistic applications due to its accessibility.

Stable Diffusion is not the first open source Ai art generator. Not long after the release of the first Dall-E, a developer made a publicly available service called Dall-E Mini, which quickly became an online phenomenon thanks to memes. The instrument, later renamed Craiyon, includes protection mechanisms similar to those of the official versions of Dall-E. Clement Delangue, managing director of HuggingFacea company that hosts many open source artificial intelligence projects, including Stable Diffusion and Craiyon, claims that it would be problematic if the technology were controlled by only a handful of large companies.

The potential of open source

“If you look at the long-term development, actually making technology more open, more collaborative and more inclusive is better from a security perspective“Closed” technology is more difficult for independent experts and the public to understand, continues the CEO of HuggingFace, and it is preferable for people outside the companies to be able to examine models to evaluate problems. such as prejudices based on ethnicity, gender or age Overall, the benefits of open source tools outweigh the risks.

Delangue points out that social media companies could use Stable Diffusion to develop tools capable of detecting images generated by artificial intelligence used for disinformation purposes. The developers of the company have put in a system for adding gods invisible watermarks in images made with Stable Diffusion – in order to make them more traceable – and they built one tool for finding, and then removing, problematic illustrations in training data of the model.

After becoming interested in Stable Diffusion, Simpson-Edin became the moderator of the dedicated server for the tool on Discord. The community prohibits people from posting certain types of content, including images that could be construed as child pornography. “We can’t moderate what people do on their machines, but we are extremely strict about what is posted“, says Simpson-Edin. In the short term, the limitation of the damaging effects of AI creation of art may depend more on humans than machines.

This article originally appeared on Wired US.