Embeddings

Jason Potts

doi:10.2478/csj-2022-0012

.blurhash-client-img { display: none !important; }

Embeddings

Cultural Science

Volume 14 (2022): Issue 1 (December 2022)

By: Jason Potts

Open Access

|Sep 2024

Abstract

I argue here that the concept of embedding (understood in the mathematical and computer science sense) provides a general way of understanding the relation between generative AI, written language and semiotics, and animal cognition when understood recursively. I propose this framing as an application of cultural science and suggest that this offers a new way to understand the alignment problem between humans and increasingly intelligent machines.

References

Allen, D., and Potts, J. 2023. Web3 toolkits: A user innovation theory of crypto development. Journal of Open Innovation: Technology, Market, and Complexity, 9(2).
Search in Google Scholar Back to article
Bommasani, R., Hudson, D. A., Adeli, E., Altman, R., Arora, S., von Arx, S., ... and Liang, P. 2021. On the opportunities and risks of foundation models. arXiv preprint arXiv:2108.07258.
Search in Google Scholar Back to article
Borsci, S., Lehtola, V., Nex, F., et al. 2023. Embedding artificial intelligence in society: looking beyond the EU AI master plan using the culture cycle’ AI & Society, 38: 1465-1484.
Search in Google Scholar Back to article
Cosmides, L., and Tooby, J. 1994. Beyond intuition and instinct blindness: Toward an evolutionarily rigorous cognitive science. Cognition, 50(1-3): 41-77.
Search in Google Scholar Back to article
Dopfer, K. 2004. The economic agent as rule maker and rule user: Homo Sapiens Oeconomicus. Journal of Evolutionary Economics, 14(1) 177-195
Search in Google Scholar Back to article
Granovetter, M. 1973. The strength of weak ties. American Journal of Sociology, 78(6): 1360-1380.
Search in Google Scholar Back to article
Granovetter, M. 1985. Economic action, and social structure: the problem of embeddedness. American Journal of Sociology, 91(3): 481-510.
Search in Google Scholar Back to article
Hartley, J., and Potts, J. 2014. Cultural Science: A natural history of stories, demes, knowledge and innovation. London: Bloomsbury Academic.
Search in Google Scholar Back to article
Koehrsen, W. 2018. Neural network embeddings explained. https://towardsdatascience.com/neural-network-embeddings-explained-4d028e6f0526
Search in Google Scholar Back to article
Jaspers, K. 1948. The axial age of human history. https://www.commentary.org/articles/karl-jaspers/the-axial-age-of-human-historya-base-for-the-unity-of-mankind/
Search in Google Scholar Back to article
LeYun, Y., Bengio, Y., and Hinton, G. 2015. Deep learning. Nature, 521(7553): 436-444.
Search in Google Scholar Back to article
Pagel, M. 2012. Wired for Culture: The natural history of human cooperation. London: Penguin.
Search in Google Scholar Back to article
Pinker, S. 2010. The cognitive niche: Coevolution of intelligence, sociality, and language. Proceedings of the National Academy of Sciences, 107(2): 8993-8999
Search in Google Scholar Back to article
Polanyi, K. 1944. The Great Transformation. London: Blackwell-Wiley.
Search in Google Scholar Back to article
Polanyi, M. 1958. Personal Knowledge. Chicago: University of Chicago Press.
Search in Google Scholar Back to article
Schmandt-Besserat, D. 2010. How Writing Came About. Austin: University of Texas Press.
Search in Google Scholar Back to article
Von Hippel, E., and Katz, R. 2002. Shifting innovation to users via toolkits. Management Science, 48(7): 821-833.
Search in Google Scholar Back to article
Wolfram, S. 2023. What is ChatGPT doing… and why does it work? Wolfram Media.
Search in Google Scholar Back to article