Monday, May 12, 2008
Puzzle Contest June 14th
For several years, I've been entering the US Puzzle Championship annual contest. I've never placed very highly, but I enjoy the puzzles they provide. If you are into puzzles, I recommend it. I try to complete as many puzzles as I can in the 2.5 hours they provide, but you can take as long as you like. If you want to compete for time and submit your answers, you have to pre-register. Afterwards, they make the puzzles available. For instance, you can download several years' worth of past puzzle tests.
Saturday, May 03, 2008
CFTC Requests Input on Regulating Prediction Markets
The CFTC asked for comments on whether they should legalize and regulate prediction markets. I haven't joined the discussion yet, because I'm seriously torn about whether it would be a good idea. But I feel compelled to quibble with something Dave Pennock said: "It's not often that an industry in its infancy cries out for more government oversight."
It's actually quite common. The term in the economics literature that includes this is regulatory capture. When there's a regulatory body specific to a particular industry, it's very common for industry to be the major source of expertise in the area, and so for the regulators to be reasonably friendly with the businesses. The businesses can work for regulation that limits entry, and cuts down on competition that reduces profits, and they can work together to ensure that public relations problems are addressed in a cohesive way. But cutting down on competition often means fewer choices for consumers by way of tighter controls on what products are offered.
In our case, the thing I worry about is a narrow ruling that only "socially valuable" questions can be asked, and an expensive process for deciding what innovative questions can be posed. It seems likely that some interests will work to ensure that sports and entertainment questions be declared off-limits. The companies that have the strongest interest in fighting that faction are mostly persona non grata in the CFTC's eyes, since they currently operate outside the law (TradeSports) or outside the country (BetFair ).
The narrower the set of approved questions, or the more expensive the process of getting approval, the less chance that markets will be commercially successful. I think the experiments within companies have indicated (though not proven) that a mix of valuable and popular claims is necessary in order to attract continuing participation.
My biggest worry about fighting for CFTC regulation at this point is that they'll approve something narrow, and this won't produce enough successes to demonstrate that loosening the restrictions over time would be beneficial. The alternative is to continue to find ways to introduce markets under the radar and demonstrate their value to the academic audience, which could lead to a friendlier hearing in a more distant future after prediction markets have demonstrated social value and little risk of harm.
Of course the other likely outcome is that the novel experiments don't happen because of the threat of litigation or regulation. But that seems unlikely given the growth in internal markets within companies. I think there's more likelihood of long-term success without regulation than with it, and we're better off waiting until the chances that the regulations will provide a broad approval are significantly higher.
Friday, May 02, 2008
Zocalo News
I've been busy with a major home remodel recently, so I haven't had a chance to crow in public about some great news for Zocalo, my open source prediction market project. I have two consulting contracts now that are paying for ongoing improvements in the software. Together they are keeping me busy full-time.
I have been working on development of Zocalo since 2004, including a period of 18 months as a Research Fellow at CommerceNet. I've been busy with personal matters for much of the last 8 months (a major home remodel), so I wasn't able to put in as much time as I'd have liked recently, but I've been working on the code again full-time for about two months.
I'm pleased to be able to say that I have two consulting contracts at this point. I'm working with a group at Chapman University and another university I'm not allowed to mention in public announcements. The Chapman team is led by Dave Porter, who I worked with while he was at George Mason University. Most of the Experimentalists from the GMU Economics department have moved (or are in the process of moving) to Chapman in Orange County, California. Dave has been using Zocalo for economics experiments since 2005, while I was at CommerceNet. He has plans (and budget) to expand Zocalo to support a variety of experiments that he'd like to do. The software continues to be used at George Mason as well.
The other group is probably familiar to most of you, though my contract says I can't use their name for publicity without approval (which they didn't give). Suffice it to say, I'm happy to be working with this group; the professor in charge has been working on market-related software systems for almost 20 years.
These consulting contracts support my continued development of Zocalo, and both groups are fully supportive of the open source approach. Having these groups actively working with the software, requesting changes, and reviewing progress will contribute substantially to the usefulness and usability of the code. The fact that one group is working with the experiment configuration and the other with the prediction markets ensures that both will continue to be enhanced and get more robust as they are being used.
This announcement is being cross-posted to midasoracle.org
Wednesday, April 23, 2008
C. J. Cherryh: Rider at the Gate
I really enjoyed 's Rider at the Gate and will be looking for the sequel. I've enjoyed all of what I've read previously by , and so I was surprised at my reaction when I recently read her Rusalka. But now that I look at her bibliography, I see that I've only read her books that are categorized as science fiction, even when they seemed on the fantasy side to me. I would certainly have categorized Rider as fantasy, since it depends heavily on ESP; but that's the only magic that is present. And to my vague recollection Wave Without a Shore seemed like fantasy as well.
But anyway, it was the characters in Rider that had me captured, and the characters in Rusalka that never came to life for me. In a lot of 's stories, the fascinating thing is the way she juxtaposes characters of different species and makes them all more interesting by their contrasts. (And shows us different facets of being human through this lens.) In both these series, all the characters are human (discounting the psychically active horses in Rider. They have tastes and personalities, but only develop goals and plans when allied with a rider.)
Perhaps the difference is that the characters in Rider are actively trying to solve their problems, while the characters in Rusalka are reluctant heroes. Yes, that's certainly a part of it; I've never liked reluctant hero stories, going back to 's Thomas Covenant series, most of which I read in college. While I was reading Rusalka I thought my distaste was also because of the dark air of the story: I'm no fan of horror. But Rider is nearly as dark and brooding. I think the characters' gung-ho attitudes drain the power of the darkness.
Anyway, I'm pleased that I've found another series of books by that I want to follow up on, and hopefully you'll have learned something about these books whether or not your tastes run along the same lines as mine.
Tuesday, March 04, 2008
James Flynn: What is Intelligence?
In his new book, What is Intelligence?, tries to explain a few things. First he wants to explain what intelligence is and what its components are, second he wants to explain his new understanding of the Flynn effect, and what it implies about genes and intelligence, and thirdly, he wants to convince us that what The Bell Curve said about intelligence and race isn't supported by these new understandings. He succeeds admirably at the latter two; his success in explaining the nature of intelligence is limited.
For anyone who isn't familiar with the Flynn Effect, I'll repeat the findings briefly. More than two decades ago, noticed that IQs have been going up over time. About 3-5 points per decade, independent of culture, location, sex and race. The people who write intelligence tests have known for quite a while; they reissue their tests every decade or so, and "re-norm" the results. Since the definition of IQ is that 100 is the average score across the population (which population? That's a separate question; read the book if you want the details) they have to measure the results for a standardized group, and set the scoring so the current test will give the right results.
One of the consequences that matters to is the implication for death penalty cases, which he has been brought into recently. The implication is that if you give someone a test that is 10 to 15 years out of date, their score will be artificially inflated, since they are being measured by the norms of an earlier period. The obvious argument among defenders of capital cases is that death row inmates should be tested by up-to-date standards so as not to inflate their scores and accidentally rate them as competent to stand trial when they are in fact borderline or below it. points out that it's common for schools in disadvantaged areas and for prisons to not replace their existing stock of test booklets when a revision is issued, so they can be significantly out-of-date, which artificially inflates the scores and negates one escape route.
Like all good scientific revolutions, starts with four paradoxes arising from the combined data about rising scores.
- Different sub-tests (e.g. vocabulary, spatial reasoning, abstract analogies, pattern matching) have shown different increases. What's different about the areas in which intelligence is growing the fastest?
- Given the size of the increase, why doesn't it seem clear in everyday interactions that each generation is significantly smarter? 20 years is almost 10 IQ points, so two generations is nearly 20.
- How did our ancestors get by if only 100 years ago, everyone was mentally retarded by current standards?
- The changes are so rapid that they can't be genetic, so they must be due to environmental changes, yet studies comparing twins raised together and apart show that environment makes little difference to adult intelligence. Why does the environment make so much difference in some cases and so little in others?
's resolution is that the environmental differences that matter are large-scale and societal. He also argues that the societal differences compound, so even though small changes are scattered throughout our schooling, entertainment, child-rearing practices, employment expectations, and hobbies, the effects can be pervasive. The area of change that pinpoints is reliance on abstraction. This turns out to be a common thread among the sub-tests with the highest increases. Our ancestors dealt with the world much more concretely, and modern child rearing, education and entertainment all exercise our growing competence at abstraction. The results from twin studies are dominated by society-wide practices, and show that which family one is raised in, or which schools one goes to don't matter nearly as much as which era, and which society. An agrarian society that doesn't expect its children to grow up and leave the farm raises them to focus on the here and now. Expectations change when horizons open up, and we should expect every society to undergo a Flynn effect as people expect the next generation to live in cities, work in information-intensive jobs, and socialize with people who aren't all doing the same work their ancestors have done since time immemorial.
Ultimately, 's book provides a satisfying resolution to the problems raised by IQ differences. The implications of Murray and Herrnstein's The Bell Curve for racial differences have been neutralized. Not by ethical arguments or posturing, but by a careful analysis of the data. Murray and Herrnstein were led astray by the surface implications of the data when analyzed within generations. If they hadn't written up their analysis carefully and thoroughly, wouldn't have been impelled to revisit the data and produce a sounder conclusion. Murray and Herrnstein's conclusions weren't original with them; their contribution was their willingness to explain an unpopular idea carefully enough that its limitations would become visible when the right context became apparent.
Murray and Herrnstein's other conclusions still stand: modern societies do an extremely good job of separating out the (relatively small, we now know) within-generation differences in intelligence, and directing people to different pursuits and occupations. The consequences is a shortage of general problem solvers in areas where intelligence is less valuable, while our institutions evolved in circumstances where general problem solvers were widely distributed.
Sunday, February 24, 2008
One of the big new features of Leopard, the current release of Apple's OS X is Spaces, and I was really looking forward to using it. Unfortunately, the actual details fell short of my expectations, and I have turned it off. I've used similar features before (under X Windows, for instance) and being able to organize a larger virtual desktop can make handling many simultaneous open windows easier.
I currently have 22 application windows either open on my desktop, or collapsed in the dock. It's not unusual for there to be 10-15 open browser windows, but right now I have only 8. I have a couple of terminal windows for talking to remote computers, three emacs windows (two currently collapsed), Word, ITunes, two for Numbers (Apple's spreadsheet program), one Preview pane, Idea, Thunderbird, and Shrook (blog reader). I'd expect to separate tasks by project, so I might have a Space for tracking Real Estate, one for working on Zocalo, one for reading blogs and web pages, and so on. Without Spaces, each shelved project takes up several slots in the dock, making it harder to find whatever I'm looking to do next.
When I attempted to navigate between applications using the keyboard, Spaces would throw me around somewhat arbitrarily, breaking whatever train of thought I had going. If I used keyboard commands to switch applications, I expect the system to choose a window for that application that is already open in the current space, or if there are none, to allow me to use Command-N or Command-O to open a new one. Instead, it would arbitrarily choose an open window for that application and switch me to whatever space contained it.
In the end, I decided that I'm better off with a cluttered dock, and a single desktop than with their implementation of Spaces. Maybe the next version will do better.
Thursday, January 24, 2008
Harry Turtledove: The Gladiator
's The Gladiator, provides a much better entrypoint to libertarian science fiction for young people than The Walton Street Tycoons, which was nominated for the Prometheus award last year. The Gladiator is part of 's Crosstime Traffic series (aimed at young adults), which I hadn't noticed before.
The main characters of this volume are high school students in an alternate Italy in which the Soviet Union won the cold war and most of the world is communist. These youngsters have all been brought up to believe that capitalism is a far worse system than communism, which they can see leaves a lot to be desired. Since they never get a glimpse of capitalism, they have no concept that there could be advantages to it. Into this milieu some visitors arrive from an alternate reality (presumably ours). They come in the guise of a chain of game stores offering simple face-to-face fantasy games of building and running railroads, managing sports teams, or battling dragons. Their plan is to gently undermine the world-wide commuist regime by teaching a few people at a time that capitalism has its good points, too. This is probably the most fantastic aspect of the novel. No, I take it back; there are certainly people who would believe that that strategy might work.
Anyway, the Italian anti-subversion squads figure out what is going on and stage a series of raids to capture the stores' operators and shutter the stores. One of the visitors from the alternate timeline is away from his store at the time of the raid, and has to figure out how to get back, leading a few sympathetic and helpful youngsters further astray.
The device of having the viewpoint characters believe wholeheartedly in communism works well. shows us how easy it is to get people to follow a unanimous crowd. Everyone doubts that the system works well, but everyone also knows that there are spies and informers everywhere, so no one voices their doubts. The official line is that Communism is the only system that works, and since no one speaks up for Capitalism, everyone assumes that if there's a better system than the one they see around them, it must be in some other direction, since the failings of Capitalism are so widely repeated.
The characters are believable high school students, worried about popularity, grades, and other students jockeying for power in student politics. (Though in this world, student politics can lead to real-world power.) They learn lessons from plausible circumstances, sometimes not seeing the whole picture immediately, and other times reaching a conclusion that other events have prepared them for. Quite convincing, and very well written. It's not grand space opera, but you can cover big topics in a small scope, as has shown with his Discworld novels. does at least as well, and paints a convincing picture of young people living under oppression and yearning for freedom.
Tuesday, January 01, 2008
The Guardener's Tale, Bruce Boston
's The Guardener's Tale is up for the Prometheus award for this year, but I'm not particularly impressed with it. The first part recapitulates 's This Perfect Day, but a lot more woodenly.
There is a clever section in the middle that feels more like Total Recall, except that the protagonist is struggling to break out of the dream vacation. This portion actually lives up to the blurb's billing; it's reminiscent of the best of Philip K. Dick. The protagonist wants to convince his wife that they should break up, so he wants to ruin their "dream vacation". He soon discovers that the dream is heavily scripted and his wife's part is played by a zombie. He concludes that they are in separate simulations, and that he can't do anything to affect her experience.
When they return from the vacation, the dreary story-telling resumes. From this point, the plot is mostly predictable. Eventually most of the characters are mind-wiped or pacified and returned to their proper place in society. A few have happier outcomes, but doesn't make them very plausible.
The story is framed as the report of one of the guards (the Guardener
of the title), but the viewpoint isn't maintained consistently. (Sometimes unusual features of the society are explained from a modern viewpoint, and other times as if by someone who grew up with them.) The guard's change of heart isn't motivated enough to be convincing, so the framing falls flat in the one place it might have changed the way we felt about the teller of the tale.
Overall, this was a disappointing book. The story is definitely a dystopia, but it wasn't very inventive, and it didn't hold my attention very tightly. I don't think there were any new insights about how tyrannies arise, how they persevere or fail, or why some people suffer quietly and others don't.
Saturday, December 22, 2007
Adam Roberts: Gradisil
In 's Gradisil the pioneers who settle near space around the Earth fight for their political freedom, yet somehow the viewpoint characters are unsympathetic enough that it's hard to root for them. The story follows several generations of the family that leads the fight; their cause is worthy, but they're so dysfunctional and spend so much of their time pushing at cross purposes to the higher goal that I was willing to give up on them several times.
The SF is solid; the idea is that the magnetic fields around the planet are real and coherent enough that engines can be built cheaply to exploit them and climb into space. This puts near Earth orbits within the grasp of individuals. It's a new frontier, away from the control of any particular government, so the people who move there are loners, escapists, and fringe cases of many kinds. There aren't many commercial opportunities to exploit at first, and it's hard to track the ships and stations, so the society that emerges is extremely loose-knit for a long time. There is some sense of community and neighborliness, but people who want to be left alone are left alone.
Eventually the governments figure out that having so many misfits flying overhead in uncontrolled space is a concern, and they decide to pacify and take over. The uplanders resist in a passive way that exploits their strengths, or at least relies on their smallest weaknesses. I loved the depiction of a war that is controlled by the lawyers: all the generals understand that winning on the battlefield but losing in the courtroom is not winning at all, so strategy and tactics have to be approved by the lawyers before any warlike actions can be taken.
The actual battle scenes, when they finally occur are plausible. A new environment and new technology lead to new tactics. The invaders aren't as familiar with the technology or the environment, so their expectations can be exploited by the native defenders.
The bottom line is that the Science Fiction is plausible and provides setting rather than being the focal point, the good guys are fighting for something important, but the viewpoint characters, even as they mature and are replaced by their progeny, are hard to sympathize with. The action is interesting, but it's a long struggle to get through the whole thing.
As a nominee for the Prometheus award, it lacks any explicit or implicit invocation of themes of freedom. This is a glaring weakness, since the opportunities were rampant. The SF was reasonably well developed, and that has to count in the book's favor, but I didn't enjoy the character development. I don't see Gradisil as a strong contender.
Wednesday, December 19, 2007
Ken MacLeod: The Execution Channel
's The Execution Channel is a near-future story from a recently diverged history. The science fiction is minimal, but sufficient to keep the book off the main-stream shelves. It's an adrenaline-pumping adventure/chase story that takes a distinct political stance against the recent growth of the security state.
The story follows government operatives and members of the counterculture in the aftermath of a series of apparent terror incidents in Britain. The first incident might be a nuclear explosion at a military base, but one of the main characters (participating in a peacenik stakeout at the base) saw and photographed delivery of a strange device before the explosion. She has a brother in the military who blogs about daily life, and her father works in intelligence. We follow them as various international government agencies track and connect them, and then decide what actions to take to contain them.
This novel has an unusual feel for , since it is mostly conventional fiction in a near present setting. The divergent history is only present to argue that national politics doesn't make as big a difference to how events unfold as people think. I thought he pulled this part off well, making a surprising argument with only tiny effects on the story. The other SF aspect of the story is the effect behind the explosions; since a handful of the characters spend their waking hours spreading disinformation, the hints about the resolution are easy to discount on first reading.
Mostly has found a good readable adventure story to wrap around a commentary on ubiquitous surveillance, government malfeasance, torture, and current events. The story is quite readable, and the themes will resonate for libertarians and other anti-authoritarians and privacy zealots. I think it's a good candidate to win the Prometheus award this year.
Peter McCluskey had a different reaction to the book.Wednesday, December 05, 2007
Keith Stanovich: The Robot's Rebellion
, in his book The Robot's Rebellion , takes the stance that we are vehicles driven by our genes and memes, and tries to give us the tools and a place to stand to figure out what matters to us. (The metaphor is that we are robots driven by these influences, and we should want to regain control for ourselves.) Since the only tools we can use to reason with and all of our values are held by and in the control of our genes and memes, this is a daunting task.
Without explicitly recognizing that he's discussing epistemology, does a commendable job of presenting a summary of the current research on standard biases in human reasoning. Once you understand the predilections of the tools you rely on, you can try to compensate for them, and start to figure out what you want. 's proposal is fundamentally consonant with Pancritical Rationalism. (Which is the source of the name of this blog.) The metaphor he uses is that of repairing a ship plank-by-plank while at sea. Regardless of how much or how little confidence you have in the current framework, you have to stand somewhere in order to start the process of examining what's there and replacing parts you don't have confidence in.
Much of the book repeats stories and results that have been widely reported in such popular books as Stumbling on Happiness, Adapting Minds, The Mating Mind, and The Blank Slate, but this material is easy to skim. spends a lot of ink explaining that some of our analysis is done by mechanisms that are built-in and harder to introspect on or to change. This is relevant later when he talks about reconciling different desires.
One example of meta-rationality that presents well is the point that introspection on your values may lead you to find apparent conflicts: you enjoy doing something, but wish you enjoyed it less, or you don't enjoy it and you wish you did. He provides a notation for talking about this kind of situation which I found kind of clumsy, but the idea of thinking about such things and having a language for analyzing them is valuable. He explains why you might have these conflicts, and why it is valuable to reason about the conflict from a viewpoint that is meta to both. Once you decide which desire is more important, he also shows that it's possible to use that understanding to bring your values into alignment, even when it's the more basic, inbuilt drive that you want to change. (I blogged last year about goals and meta-goals as ends and means).
only spends about 20 pages on identifying and defusing opinions and desires that serve to protect your memes from your introspection, but these sections are his most valuable contribution. The memes that set up a self-reinforcing structure that forbid evaluation of the meme-complexes themselves are the ones that most deserve concentrated attention. I think he explains this point well enough that people in the grip of religious (or other defensive) ideas would be able to see how the prohibition on introspection only serves the meme-cluster, which might help them get over the hurdle and start down a reflective epistemological path, and figure out what their own goals are.
Unfortunately, ends the book by trying to show that markets subvert the goal of reconciling our desires and meta-desires. His argument is that markets only pay attention to money, and so the people with the most money get what they want and everyone else gets nothing. What this misses is that of all the actually possible social institutions, markets are unique in not giving a few people complete control of the economy. In a market, some people have more money and therefore get to command more resources, but anyone who has some money can still use it to buy some of what they want. The great failing of socialism is that only the politicians get a voice. But this is a minor failing of the book. On the whole, it's nice to see a book that learns from Evolutionary Psychology, and uses those ideas to help people learn how to think about what they want.
Saturday, December 01, 2007
Andy Clark: Being There
's Being There is a book on intelligence and AI. Clark's main point is that all known intelligence is situated; it relies on context and the local environment to cue behavior, rather than redundantly modeling the environment at significant expense.
The book was recommended to me when I mentioned Greg Egan's Diaspora again as a description of how I imagine an AI might come to self-awareness. I had hoped that the book would provide information on building AIs using situated approaches and some examples of successes, but the focus is on demonstrating that human and animal behavior and cognition rely heavily on context and environment. gives plenty of examples and describes experiments on infant locomotion to show that even crawling and beginning to walk are responses to environment cues.
As an argument that both learning and action in humans and many other creatures often appear only in response to environment cues, the book is reasonably thorough. As an argument that this is the only way that it could be, it falls short.
Most of the discussion about how this applies to AI are in examples of past projects in which someone discovers that eschewing representation, and striving to build something that will perform reactively simplifies the problem immensely. This is fine and useful for projects that want to solve particular problems (build a robot that can dance or mow the lawn, or find coke cans in a cluttered lab).
The argument that self-awareness may also require interaction with the environment seems different to me. 's examples all have the form that the environment is its own best representation, and using direct observation to cue performance is more efficient. This is true as far as it goes, but we already know that reasoning creatures have internal models that reflect object persistence, agency, permeability, and many other features of the objects around us that we can't recall by looking around us.
As in vignette, thinking creatures seem to come to self awareness by playing with the world through our innate sensors and effectors, and discovering that there are parts of the world that are out of our control and parts that are under our control. Still later we figure out that some of the parts that we control are ourselves and other parts merely ours temporarily. Later we realize that some of the parts we don't control are other agents with their own intentions, and we can affect them only indirectly. In Egan's version, the final step in coming to awareness is realizing that we and the other agents are the same kind of thing.
So while being situated is crucial in coming to awareness, the interaction between internal models and an external world that we can affect but that we can't control unilaterally seems crucial. focus is only on the ways in which relying on the environment simplifies the problems of an agent interacting with the world. I think this will help people produce useful tools, but without internal models, I expect them to continue to fall short of awareness or reasoning beyond the immediate situation.
Subscribe to:
Posts (Atom)
