So You Want to Be a Punctual Engineer: Critical Careers of the Future

Couldn’t attend Transform 2022? Discover all the summit sessions now in our on-demand library! Look here.

The designers have a great understanding of how stories are concisely shaped with an eye for design. Recently, cartoonist extraordinaire Roz Chast appeared in the New Yorker SLAB images and I was immediately drawn to its prompts beyond the actual machine output.

The title of the article, “DALL-E, make me another Picasso, please” is a pun like the old one lenny bruce joke about a genie in a bottle giving an old man anything he wants. The old man asks the genie to “make me a malt” and poof! the genie turns it into a milkshake.

Like the gift of genius, AIs are powerful but unruly and open to abuse, making the intercession of a speedy engineer a new and important work in the field of data science. These are people who understand that in building demand, they will rely on shrewd skill and perseverance to extract a good (and not harmful) result from the mysterious soul of a machine. The best AI-savvy engineers would be those who actually consider whether there is a need for more derived Picasso art, or what obligations should be considered before asking a machine to plagiarize the work of a famous painter.

Concerns of late have focused on whether DALL-E will change the already eternally muddy definition of artistic genius. But asking who qualifies as creative misses the point. What is art and who can claim the title of artist are philosophical (and rarely ethical) questions that have been debated for millennia. They do not address the fundamental fusion that occurs between data science and the humanities. Successful rapid crafting, whether for DALL-E or GPT-3 or any future algorithm-based image and language model, will require not only an engineer’s understanding of how machines learn, but a in-depth knowledge of art history, literature and librarianship. as well.


MetaBeat 2022

MetaBeat will bring together thought leaders to advise on how metaverse technology will transform the way all industries communicate and do business on October 4 in San Francisco, California.

register here

Artists and designers who claim this type of AI will end their careers are certainly invested in how this integration will progress. Vox recently released a video titled “What AI Art Means for Human Artistswhich explores their anxiety in a way that acknowledges that there is very real evolution at hand despite the current dearth of “quick craft” and wordsmithing involved. People are only just beginning to realize that we are in danger of reaching a point where trademark protection of a word or phrase would not protect intellectual property in the same way it does now. . What aspect of a prompt could we even copyright? How would derivative works be recognized? Could there be a metadata tag on each image indicating whether it is “appropriate or authorized for AI consumption?” No one seems to mention these speed bumps in the rush to get a personal MidJourney account.

Alex Shoop, engineer at data crawler and an AI systems design expert, shared some thoughts on this. “I think an important aspect of the ‘engineer’ part of the ‘fast engineer’ will include adhering to best practices such as robust testing, repeatable results, and using technologies that are safe and secure,” he said. “For example, I can imagine a prompt engineer setting up many different, slightly varied prompt texts, such as ‘cat holding a red balloon in a garden’ vs. cat holding a balloon blue in a garden” to see how small changes would lead to different outcomes even if DALL-E and generative AI models are unable to create deterministic or even repeatable outcomes. Despite this inability to create predictable artistic results, Shoop says he thinks at least test and track experiment setups should be a skill he would expect to see in a true “fast engineer” job description.

Before the rise of high-end graphics and user interfaces, most science and engineering students saw little need to study visual arts and product design. They weren’t as utilitarian as the code. Now, technology has created a symbiosis between these disciplines. The author who contributed the original descriptions of the reference text, the cataloger who constructed the image metadata as it was extracted and then dumped into a repository, the philosopher who assessed the bias implicit in the data set provide all the insights needed in this brave new world of image generation.

The result is a fast engineer with a similar skill mix who understands the repercussions if OpenAI uses more male artists than female. Or if the art of one country is more represented than that of another. Ask a librarian about the intricacies of cataloging and categorizing as it has been done for centuries and they will tell you: it’s laborious. Rapid engineering will require attention to relationships, subgroups and location, as well as an ability to examine censorship and respect copyright laws. During DALL-E training on representative images of the mona-lisahumans in the loop aware of these details were key to reducing bias and encouraging fairness in all results.

It’s not just offensive abuse that can be easily imagined. In a fascinating turn of events, there is even multi-million dollar art forgeries reported by artists who use AI as their medium of choice. All huge datasets or large model networks contain, buried deep within the data, intrinsic biases, labeling flaws, and outright fraud that challenge quick ethical fixes. Natalie Summers of OpenAI, who leads OpenAI’s Instagram account and is the “human in the loop” responsible for enforcing rules meant to protect against outings that could damage reputation or incite outrage, expresses similar concerns.

This leads me to conclude that to be a fast engineer is to be not only responsible for creating art, but also ready to serve as a gatekeeper to prevent abuses like counterfeiting, hate speech, copyright violations. authorship, pornography, deepfakes and more. Sure, it’s fine to produce dozens of surreal and slightly disturbing Dada art “products,” but there should be something more compelling buried under the mound of dross resulting from a throwaway visual experience.

I believe DALL-E has brought us to an inflection point in the art of AI, where artists and engineers will need to understand how data science manipulates and enables behavior while also being able to understand how machine learning models. In order to design the output of these machine learning tools, we will need experience beyond engineering and design, similar to how understanding the physics of light and aperture takes photographic art beyond the banal.

Image adapted from Professor Neri Oxman”cycle of creativity.”

This diagram is an abbreviation of Professor Neri Oxman’s Creativity Cycle.” His work with the Mediated Matter research group at MIT Media Lab explored the intersection of design, biology, computer science, and materials engineering with an eye to how all of these fields interact in different ways. optimal with each other. Likewise, to become afast engineer(a still-nonexistent job title that has yet to be officially adopted by any discipline), you will need an awareness of these intersections as broad as his. It is a serious job with several specialties.

Future DALL-E artists, whether self-taught or schooled, will always need to be able to communicate and conceive of an original point of view. Like any librarian with skills in image metadata and preservation; like any engineer capable of structuring and testing reproducible results; like historians able to relate Picasso’s influences to what was happening in the world as he painted about war and beauty, “the speedy engineer” will be an artistic career of the future, requiring a mix of scientific and artistic that will guide the algorithm. It will always be the humans who inject their ideas into the machines in service of the newer and ever-changing design language.

Tori Orr is a member of DataRobot’s AI Ethics Communications Team.


Welcome to the VentureBeat community!

DataDecisionMakers is where experts, including data technicians, can share data insights and innovations.

If you want to learn more about cutting-edge insights and up-to-date information, best practices, and the future of data and data technology, join us at DataDecisionMakers.

You might even consider writing your own article!

Learn more about DataDecisionMakers

Comments are closed.