Alibaba has new Open Source to generate videos. The problem is that it is being used to generate pornographic deepfakes

Last week Alibaba launched Wanx 2.1a new AI model for video generation that competes with others such as Sorafrom OpenAi, or I see 2from Google. The tool ended up becoming 24 hours later the person responsible for dozens of pornographic videos They will be published on the Internet.

Wanx 2.1 is also an Open Source model whose code It is available in github. Very soon users fond of pornographic content and who also possessed the appropriate technical knowledge took advantage of that fair model for that: to generate porn videos.

They told it in 404 averagewhere they indicated how in communities dedicated to producing and sharing pornographic deepfakes without the consent of the people represented, the users were “salivating” because of the advanced Alibaba model.

Some of those videos were shared in Civitai, A platform in which users share images and videos generated with AI tools, but in which such images are also bought and sold.

The statistics that we can find in the pages of the AI ​​models used to create those images and video show how These models have already been downloaded hundreds of times by users.

There are already dozens of pornographic videos created with WAN 2.1, indicate in 404 average. In Civitai, users are allowed to share AI models, but unseeled pornographic content is not allowed. That does not prevent users from discharging the models and use them to produce these models themselves, they affirm in this medium.

The problem is once again the use of tools that, of course, allow perfectly appropriate and spectacular videos, but can also be used for uses such as these. We already saw how this type of Deepfakes They can become very profitableand the advance of these tools makes it difficult to control this type of content.

In Xataka | In South Korea, Deepfake Porn has become a nightmare. Your solution: three years in jail for those who see it

Leave a Comment