Choosing between small, likely rewards and large, unlikely rewards activates inferior and orbital prefrontal cortex.
(17/3403)
Patients sustaining lesions of the orbital prefrontal cortex (PFC) exhibit marked impairments in the performance of laboratory-based gambling, or risk-taking, tasks, suggesting that this part of the human PFC contributes to decision-making cognition. However, to date, little is known about the particular regions of the orbital cortex that participate in this function. In the present study, eight healthy volunteers were scanned, using H(2)(15)0 PET technology, while performing a novel computerized risk-taking task. The task involved predicting which of two mutually exclusive outcomes would occur, but critically, the larger reward (and penalty) was associated with choice of the least likely outcome, whereas the smallest reward (and penalty) was associated with choice of the most likely outcome. Resolving these "conflicting" decisions was associated with three distinct foci of regional cerebral blood flow increase within the right inferior and orbital PFC: laterally, in the anterior part of the middle frontal gyrus [Brodmann area 10 (BA 10)], medially, in the orbital gyrus (BA 11), and posteriorly, in the anterior portion of the inferior frontal gyrus (BA 47). By contrast, increases in the degree of conflict inherent in these decisions was associated with only limited changes in activity within orbital PFC and the anterior cingulate cortex. These results suggest that decision making recruits neural activity from multiple regions of the inferior PFC that receive information from a diverse set of cortical and limbic inputs, and that the contribution of the orbitofrontal regions may involve processing changes in reward-related information. (+info)
Attentional orienting is impaired by unilateral lesions of the thalamic reticular nucleus in the rat.
(18/3403)
The thalamic reticular nucleus (TRN) has been implicated in attentional processes based on its anatomical, electrophysiological, and neurochemical relationships with the sensory nuclei of the thalamus and corresponding sensory areas of cortex. This study examined the possibility that the TRN is involved in covert orienting of attention. Attention can be summoned to a spatial location in the absence of an overt orienting response. The reaction time to a visual target is faster when attention has been drawn to the location of the target by a preceding cue in that location (valid cue) compared with when the cue misdirects attention (invalid cue) away from the location of the subsequent target. This reaction time difference is referred to as the "validity effect." Rats were trained to perform such a reaction time task with visual cues and targets presented in poke holes to either side of the rat's head, which had to be maintained centrally and still. If the rat made an overt orienting response to the cue, the trial was aborted. Unilateral lesions were made by injection of ibotenic acid in the TRN. After surgery, there was no bias apparent in their responding; they were as likely to initiate responses and were equally accurate to either side. There was, however, a complete abolition of the validity effect for responses to contralateral targets. The data are discussed in terms of a role for the TRN in attentional processing. (+info)
Effect of expected reward magnitude on the response of neurons in the dorsolateral prefrontal cortex of the macaque.
(19/3403)
The dorsolateral prefrontal cortex plays a critical role in guiding actions that ensue seconds after an instruction. We recorded from neurons in area 46 and the frontal eye field (FEF) while monkeys performed a memory-guided eye movement task. A visual cue signaled whether a small or large liquid reward would accompany a correct response. Many neurons in area 46 responded more when the monkey expected a larger reward. Reward-related enhancement was evident throughout the memory period and was most pronounced when the remembered target appeared in the neuron's response field. Enhancement was not present in the FEF. The mixture of neural signals representing spatial working memory and reward expectation appears to be a distinct feature of area 46. (+info)
How the basal ganglia use parallel excitatory and inhibitory learning pathways to selectively respond to unexpected rewarding cues.
(20/3403)
After classically conditioned learning, dopaminergic cells in the substantia nigra pars compacta (SNc) respond immediately to unexpected conditioned stimuli (CS) but omit formerly seen responses to expected unconditioned stimuli, notably rewards. These cells play an important role in reinforcement learning. A neural model explains the key neurophysiological properties of these cells before, during, and after conditioning, as well as related anatomical and neurophysiological data about the pedunculopontine tegmental nucleus (PPTN), lateral hypothalamus, ventral striatum, and striosomes. The model proposes how two parallel learning pathways from limbic cortex to the SNc, one devoted to excitatory conditioning (through the ventral striatum, ventral pallidum, and PPTN) and the other to adaptively timed inhibitory conditioning (through the striosomes), control SNc responses. The excitatory pathway generates CS-induced excitatory SNc dopamine bursts. The inhibitory pathway prevents dopamine bursts in response to predictable reward-related signals. When expected rewards are not received, striosomal inhibition of SNc that is unopposed by excitation results in a phasic drop in dopamine cell activity. The adaptively timed inhibitory learning uses an intracellular spectrum of timed responses that is proposed to be similar to adaptively timed cellular mechanisms in the hippocampus and cerebellum. These mechanisms are proposed to include metabotropic glutamate receptor-mediated Ca(2+) spikes that occur with different delays in striosomal cells. A dopaminergic burst in concert with a Ca(2+) spike is proposed to potentiate inhibitory learning. The model provides a biologically predictive alternative to temporal difference conditioning models and explains substantially more data than alternative models. (+info)
Primary CA1 and conditionally immortal MHP36 cell grafts restore conditional discrimination learning and recall in marmosets after excitotoxic lesions of the hippocampal CA1 field.
(21/3403)
Common marmosets (Callithrix jacchus, n = 18) were trained to discriminate between rewarded and non-rewarded objects (simple discriminations, SDs) and to make conditional discriminations (CDs) when presented sequentially with two different pairs of identical objects signifying reward either in the right or left food well of the Wisconsin General Test Apparatus. After bilateral N-methyl-D-aspartate (0.12 M) lesions through the cornu ammonis-1 (CA1) field (7 microl in five sites), marmosets showed profound impairment in recall of CDs but not SDs, and were assigned to lesion only, lesion plus CA1 grafts and lesion plus Maudsley hippocampal cell line, clone 36 (MHP36) grafts groups matched for lesion-induced impairment. Cell suspension grafts (4 microl, 15-25 000 cells/microl) of cells dissected from the CA1 region of foetal brain at embryonic day 94-96, or of conditionally immortalized MHP36 cells, derived from the H-2Kb-tsA58 transgenic mouse neuroepithelium and labelled with [3H]thymidine, were infused at the lesion sites. The lesion plus MHP36 grafts group was injected five times per week with cyclosporin A (10 mg/kg) throughout testing. Lesion, grafted and intact control marmosets (n = 4-5/group) were tested on recall of SDs and CDs learned before lesioning and on acquisition of four new CDs over a 6-month period. Lesioned animals were highly impaired in recall and acquisition of CD tasks, but recall of SDs was not significantly disrupted. Both grafted groups of marmosets showed improvement to control level in recall of CDs. They were significantly slower in learning the first new CD task, but mastered the remaining tasks as efficiently as controls and were substantially superior to the lesion-only group. Visualized by Nissl staining, foetal grafts formed clumps of pyramidal-like cells within the denervated CA1 field, or jutted into the lateral ventricles. MHP36 cells, identified by beta-galactosidase staining and autoradiography, showed neuronal and astrocytic morphology, and were distributed evenly throughout the CA1 region. The results indicate that MHP36 cell grafts are as functionally effective as foetal grafts and appear to integrate into the host brain in a structurally appropriate manner, showing the capacity to differentiate into both mature neurons and glia, and to develop morphologies appropriate to the site of migration. These findings, which parallel the facilitative effects of foetal and MHP36 grafts in rats with ischaemic CA1 damage, offer encouragement for the development of conditionally immortal neuroepithelial stem cell lines for grafting in conditions of severe amnesia and hippocampal damage following recovery from cardiac arrest or other global ischaemic episodes. (+info)
Role of adenosine A2 receptors in brain stimulation reward under baseline conditions and during cocaine withdrawal in rats.
(22/3403)
The present experiments tested the hypothesis that adenosine A2 receptors are involved in central reward function. Adenosine receptor agonists or antagonists were administered to animals that had been trained to self-stimulate in a rate-free brain stimulation reward (BSR) task that provides current thresholds as a measure of reward. The adenosine A(2A) receptor-selective agonists 2-p-(2-carboxyethyl)phenethylamino-5'-N-ethylcarboxamido adenosine hydrochloride (CGS 21680) (0.1-1.0 mg/kg) and 2-[(2-aminoethylamino)carbonylethyl phenylethylamino]-5'-N-ethylcarboxamido adenosine (APEC) (0.003-0.03 mg/kg) elevated reward thresholds without increasing response latencies, a measure of performance. Specifically, CGS 21680 had no effect on response latency, whereas APEC shortened latencies. Bilateral infusion of CGS 21680 (3, 10, and 30 ng/side), directly into the nucleus accumbens, elevated thresholds but shortened latencies. The highly selective A(2A) antagonist 8-(3-chlorostyryl)caffeine (0.01-10.0 mg/kg) and the A2-preferring antagonist 3,7-dimethyl-1-propargylxanthine (DMPX) (0.3-10.0 mg/kg) did not alter thresholds or latencies, but DMPX (1.0, 10.0 mg/kg) blocked the threshold-elevating effect of APEC (0.03 mg/kg). In another study, repeated administration of cocaine (eight cocaine injections of 15 mg/kg, i.p., administered over 9 hr) produced elevations in thresholds at 4, 8, and 12 hr after cocaine. DMPX (3 and 10 mg/kg), administered before both the 8 and 12 hr post-cocaine self-stimulation tests, reversed the threshold elevation produced by cocaine withdrawal. These results indicate that stimulating adenosine A(2A) receptors diminishes BSR without producing performance deficits, whereas blocking adenosine receptors reverses the reward impairment produced by cocaine withdrawal or by an A(2A) agonist. These findings indicate that adenosine, via A(2A) receptors, may inhibit central reward processes, particularly during the neuroadaptations associated with chronic drug-induced neuronal activation. (+info)
Modulation of brain reward circuitry by leptin.
(23/3403)
Leptin, a hormone secreted by fat cells, suppresses food intake and promotes weight loss. To assess the action of this hormone on brain reward circuitry, changes in the rewarding effect of lateral hypothalamic stimulation were measured after leptin administration. At five stimulation sites near the fornix, the effectiveness of the rewarding electrical stimulation was enhanced by chronic food restriction and attenuated by intracerebroventricular infusion of leptin. In contrast, the rewarding effect of stimulating neighboring sites was insensitive to chronic food restriction and was enhanced by leptin in three of four cases. These opposing effects of leptin may mirror complementary changes in the rewarding effects of feeding and of competing behaviors. (+info)
Cerebellar flocculus and paraflocculus Purkinje cell activity during circular pursuit in monkey.
(24/3403)
Responses from 69 Purkinje cells in the flocculus and paraflocculus of two rhesus monkeys were studied during smooth pursuit of targets moving along circular trajectories and compared with responses during sinusoidal pursuit and fixation. A variety of interesting responses was observed during circular pursuit. Although some neurons fired most strongly in a single preferred direction during clockwise (CW) and counterclockwise (CCW) pursuit, others had directional preferences that changed with rotation direction. Some of these neurons showed similar modulation amplitudes during CW and CCW pursuit, whereas other neurons showed a preference for a particular rotation direction. Response specificity also was observed during sinusoidal pursuit. Some neurons showed responses that were much stronger during centrifugal pursuit, others showed a preference for centripetal pursuit, and still others showed responses during both centripetal and centrifugal motion. Differences in preferred response direction were sometimes observed for centripetal versus centrifugal pursuit. CW/CCW and centrifugal/centripetal preferences were not explained by a breakdown in component additivity. That is, modulations in firing rate during pursuit along a circular trajectory equaled the sum of modulations during horizontal and vertical sinusoidal components as well as for diagonal components. Instead all responses were well fit by a model that expressed the instantaneous firing rate of each neuron as a multilinear function of the two-dimensional position and velocity of the eye. This model generalized well to performance at different sinusoidal frequencies. It did somewhat less well for responses during fixation, suggesting some separation in the neural mechanisms of dynamic and static positioning. The model indicates that position sensitivity accounted for approximately 36% of the modulation during circular pursuit, and velocity sensitivity accounted for approximately 64%. When position and velocity sensitivity vectors were aligned, responses were simpler and modulations were similar during CW versus CCW pursuit. In contrast, when these vectors pointed in different directions, response complexity increased. Nonaligned position and velocity influences tended to reinforce during circular pursuit in one direction and to cancel each other during pursuit in the opposite direction. They also tended to produce response differences during centripetal versus centrifugal sinusoidal pursuit. The distinct roles played by position and velocity in shaping Purkinje cell responses are compatible with the control signals required to generate smooth pursuit along circular and other two-dimensional trajectories. (+info)