Brief Notes on Hard Takeoff, Value Alignment, and Coherent Extrapolated Volition

نویسنده

  • Gopal P. Sarma
چکیده

I make some basic observations about hard takeoff, value alignment, and coherent extrapolated volition, concepts which have been central in analyses of superintelligent AI systems.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Hail Mary, Value Porosity, and Utility Diversification

This paper introduces some new ideas related to the challenge of endowing a hypothetical future superintelligent AI with values that would cause it to act in ways that are beneficial. Since candidates for first-best solutions to this problem (e.g. coherent extrapolated volition) may be very difficult to implement, it is worth also looking for less-ideal solutions that may be more easily impleme...

متن کامل

Ideal Advisor Theories and Personal CEV

Yudkowsky’s “coherent extrapolated volition” (CEV) concept shares much in common with ideal advisor theories in moral philosophy. Does CEV fall prey to the same objections which are raised against ideal advisor theories? Because CEV is an epistemic rather than a metaphysical proposal, it seems that at least one family of CEV approaches (inspired by Bostrom’s parliamentary model) may escape the ...

متن کامل

Rational Universal Benevolence: Simpler, Safer, and Wiser Than "Friendly AI"

Insanity is doing the same thing over and over and expecting a different result. “Friendly AI” (FAI) meets these criteria on four separate counts by expecting a good result after: 1) it not only puts all of humanity’s eggs into one basket but relies upon a totally new and untested basket, 2) it allows fear to dictate our lives, 3) it divides the universe into us vs. them, and finally 4) it reje...

متن کامل

Pretreatment of Gray Cast Iron for Hard Chromium Electroplating (RESEARCH NOTES)

From the standpoint of processing, hard chromium layer plate may be applied to steels, cast iron, aluminum and nickel base alloys. Cast iron can be plated provided that the surface is capable of conducting the required current and is reasonably free of voids, pits, gross silicate inclusions, and massive segregation. There are many difficulties arising from graphite phase and deposition of hydro...

متن کامل

Running backwards: soft landing-hard takeoff, a less efficient rebound.

Human running at low and intermediate speeds is characterized by a greater average force exerted after 'landing', when muscle-tendon units are stretched ('hard landing'), and a lower average force exerted before 'takeoff', when muscle-tendon units shorten ('soft takeoff'). This landing-takeoff asymmetry is consistent with the force-velocity relation of the 'motor' (i.e. with the basic property ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • CoRR

دوره abs/1704.00783  شماره 

صفحات  -

تاریخ انتشار 2017