The engineers who worked at FSD do not trust their own creation

Elon Musk has been ensuring for a decade that full autonomous driving is just around the corner. Although the company has advanced in its driving assistance systems, a Reuters investigation reveals something worrying. Several people who worked on this project have denounced that the technology continues to suffer from basic and dangerous errors, and they confess that they would not get into a Tesla autonomous car for the world. what has happened. In this investigation, Reuters had the testimonies of nine “data taggers”—the people who train that Tesl AI system—as well as a software engineer who worked on the project. According to them, vehicles with these systems collide with animals, ignore the presence of school buses or accelerate in construction zones. One of the team’s veterans summed up everything in one sentence: “we have all seen the FSD fail.” Beware of public demos. Tesla has already launched robotaxi pilot programs in cities like Austin (Texas). Musk claims that his software is a generalized system that can be adapted to any city without high-precision maps, but these interviewees indicate that the operational reality is different. The trick. Tesla staff spent months recording videos and mapping the area of ​​Austin where the tests were to take place, and they spent hundreds of hours labeling curbs or road markings just to avoid problems during the demonstrations. According to these former employees, this level of intervention is unaffordable on a global scale. Comparing pears with apples. To maintain that the FSD system is up to ten times safer than human driving, Tesla uses a methodology criticized by experts. For example, he compares his cars (4.1 years old on average, modern safety systems) with the average American car, which is almost 13 years old. Phil Koopman, a professor at Carnegie Mellon University, explained that “It’s like saying my jet plane is faster than a World War II bomber.” The data reveals that if only accidents with airbag deployment are compared, Tesla’s advantage would not be 10 to 1, but 3 to 1, and even that figure is questionable. The controversial “Mad Max” mode. Internal videos have shown Tesla cars driving at speeds much higher than those allowed after the introduction of certain aggressive driving modes like the so-called “Mad Max”. Some of the employees who participated in the investigation reported cars traveling at almost 100 km/h in zones limited to 40 km/h. This aggressive driving is often treated as a low priority problem by its engineers, despite the risk it poses to road safety in these urban environments. Investigations in progress. The National Highway Traffic Safety Administration (NHTSA) currently has four open investigations into FSD and Autopilot. These cases include situations in which Tesla vehicles ignored red traffic lights or they turned directly into oncoming traffic. Fatal accidents that occurred are also being investigated in low visibility conditions —fog, sun glare—, and where the Tesla sensors, which are focused entirely on the use of cameras, have turned out to be insufficient. Where are the robotaxis? Almost a year after its launch in Austin, Tesla’s fleet of robotaxis it’s still tinyand consists of about 50 vehicles. It is also limited to very specific areas, and in cities like Dallas or Houston, users have complained that the cars do not drop them off at their exact destination. Besides, many of these vehicles They still have human drivers in the passenger seat who are there to avoid problems. It’s a reasonable practice, but it destroys the promise of full unattended autonomy that these vehicles offer. In Xataka | Elon Musk has come up with two names for Tesla’s self-driving taxi. And legally you can’t put any on it

AI agents are promising. But as in Tesla’s FSD, you better not take your hands from the steering wheel

AI agents are one of the great trends of AI This year. There are many expectations put in these models of AI capable of completing a task from beginning to end for us and almost if our intervention. And yet, one thing seems clear: for the moment it will be better “not to remove your hands from the steering wheel” and watch every step they take to prevent the AI ​​agent from being starring. Autonomy and trust. The Tesla driving assistance system –badly called Total autonomous driving (FSD For its acronym in English) – it requires that the user trust him to get carried away and that the car takes us from a point of origin to a destination without human intervention. IA agents propose a similar idea, to complete a task from beginning to end autonomously, but for this we must trust that they are able to do so. decision making. The agents will require huge data amounts and access to updated sources of information to analyze such data and then make decisions. In the past we have seen how AI models are especially good at the time of Summarize concrete information Or to draw conclusions from limited data, which is very useful for that decision making. Learn from mistakes. Tesla cars receive FSD frequent updates to improve their behavior. These updates are nourished by the data collected by the company when your FSD system is used, what allows you to polish the service. Something similar is expected to happen with AI agents, which will improve – especially at the beginning – when they are updated and “learn from their mistakes” when processing user requests. AI and companies agents. These types of solutions will be especially striking in companies that can thus automate processes that previously required total or partial human intervention. And precisely that is why this type of integration must be done in a very controlled way, because let’s admit it: we cannot trust 100% of the current AI models. Tesla knows that FSD is imperfect. It happens of course in the FSD of Tesla, which since its inception has been involved in various accidents, some of them with fatalities. One of the most recent was notified in October 2024: the low visibility made a TESLA with FSD activated a few months ago will run a pedestrian. Tesla has been criticized on numerous occasions of misleading advertising and of save the maximum on radars and sensors To achieve greater profit margin. AI agents can be equally dangerous if they are used incorrectly and “without having their hands in the steering wheel.” Users and companies that begin to use them must keep these risks very present. The hands behind the wheel, please. The conclusion was already clear in the Tesla FSD system, but also in the case of agents. They have barely done only appear on the market shyly, but everything indicates that this is one of the great trends of AI by 2025. And the problem is that the models of AI are imperfect and therefore can make mistakes, but it is that in the agents of that error it will increase. That they tell Air Canada, who had to return money to a passenger which obtained an erroneous response from the airline chatbot. Or to Chevrolet, whose chatbot was “deceived” by a user who achieved Buy one of your cars for a dollar. Domino effect. The accumulation of errors in sequential tasks is a fundamental problem in current AI models. We could say that it is something like the domino effect or the compound error: an error in an initial action distorts all subsequent decisions, generating results increasingly far from what expected. Imagine that in applications such as finance, medicine or logistics: consequences could be terrible. Solution: Constant supervision. To avoid this problem there are several proposed solutions. One of them is the establishment of check points. Thus, at the end of each subtarte the system-and ideally, a human user, what is called Human-In-The-Loop (Hitl)-should verify that everything is going well. It is also possible to minimize the risk using redundant systems – for example, using different models of AI so that the AI ​​agent uses them separately – or taking advantage of the information of the standard limits: if an intermediate fact thrown by an AI agent is too diverted from what is expected, we should rebound that process. And for the moment, spent (very) bounded. We are in a preliminary phase, and AI agents are “learning to drive alone”, so to speak. And the best way they learn is to go step by step and always starting with relatively simple and very limited scenarios. Thus, the ideal is to try to apply them to very specific cases and with a limited and known casuistry, so that their answers are as precise. Image | Erik Witsoe In Xataka | Microsoft is very important that the agents of AI are the great ball of the year. And is being reorganized to achieve it

Log In

Forgot password?

Forgot password?

Enter your account data and we will send you a link to reset your password.

Your password reset link appears to be invalid or expired.

Log in

Privacy Policy

Add to Collection

No Collections

Here you'll find all collections you've created before.