Design of humanoid artificial hand control system combining FPGA and DSP

The humanoid artificial hand has the major social needs as the main target of rehabilitating the human hand function as a disabled patient. The ideal artificial hand should have the bionic characteristics of the human hand, mainly reflected in the three aspects of artificial hand construction, control mode and environmental perception. However, due to its limited volume and complex sensor system, the control system is put forward higher requirements.

The existing control systems are available in both external and built-in versions. External control systems are mostly used for research-type artificial hands, such as Cyber ​​Hand, Tokyo Hand, Vanderbilt Hand, etc. This control system is mainly used for the verification of algorithms and solutions, and it is less popular in the application of disabled people. The built-in control system is used in both research-type fake hands and commercial fake hands. The research-type artificial hand control system invests heavily in environmental perception and two-way information interaction, such as Smart Hand, DARPA hand; while commercial fake hand control system There are also some integrated external sensors, but the sensor system is simple, and there is a big gap in two-way information interaction, such as i-Limb, BeBionic Hand.

The HIT IV generation of false hand control system uses DSP as the main control chip, integrated with position sensor and torque sensor to sample the EMG signal. However, the control system is a whole and large, and it is only suitable for HIT IV generation fake hands. The DSP chip is weaker than the FPGA in function expansion, which is not conducive to secondary development.

In this paper, the modular design scheme is adopted, and FPGA is used as the core chip. The modules of motion control, EMG signal acquisition and electrical stimulation are independently designed and connected through a common interface. On this basis, multi-modal multi-finger capture experiments were conducted.

1 imitation artificial hand system introduction

The control system designed in this paper is controlled by HIT V. The hand is slightly smaller than the adult hand, with 5 fingers, 2 knuckles for each finger, and an internal rotation/abduction joint for the thumb. There are 11 active joints, and the whole hand is driven by 6 DC motors. Each finger is equipped with a torque sensor, a position sensor, and a fingertip six-dimensional force sensor.

The control system adopts the modular design idea, divides the whole system into several modules, establishes interconnection with each other through the common interface, so that the whole control system can be placed inside the humanoid artificial hand to realize mechatronics.

2 FPGA-based control system design

The humanoid artificial hand control system is used to realize the driving control of each finger of the artificial hand, the collection of various sensor information, and the communication with the upper computer (PC or PCI control card). The control system is composed of 10 modules, which are: a main control chip module composed of an FPGA, a USB interface module, a thumb control circuit module, an index finger control circuit module, a middle finger control circuit module, a ring finger control circuit module, a little finger control circuit module, EMG signal acquisition module, battery management system module, electrical stimulation feedback module. The modular design approach increases the flexibility and independence of the control system, making it easy to debug and modify the module separately. The overall functional block diagram of the electrical system is shown in Figure 1.

Figure 1 Functional block diagram of the electrical system

2.1 FPGA main control chip module design

The FPGA main control chip module uses Altera Cyclone III series FPGA chip EP3C25F25617 as the control core, responsible for the processing of EMG signals and various sensor signals, communication with finger circuits, USB communication, CAN communication interface and other functions. At the same time, the main control chip module is also responsible for the control of the thumb internal rotation/abduction degree of freedom driving motor. Each function is written in VHDL language. The dual NIOS core embedded in the FPGA constitutes a dual-core processor. One NIOS core is used for EMG signal processing, and the other NIOS core is used for communication. The dual core communicates through 2M EEPROM. FPGA functional block diagram is shown in Figure 2.

FPGA functional block diagram

Figure 2 FPGA functional block diagram

RS-485 communication is realized by controlling the RS-485 transceiver interface chip MAX3362 in the NIOS core with the custom component AutoSCI. The MAX3362 transceiver chip enables high-speed data transfer with a 3.3 V low voltage. CAN and LVDS communication adopts the multiplexing circuit design (Fig. 3), and the function conversion is completed by replacing the receiving and transmitting interface chip. CAN communication uses TI's CAN transceiver SN65HVD230QD as an interface chip. LVDS communication uses TI's half-duplex LVDS transceiver interface chip SN65LVDM176 to form a PPSeCo high-speed serial communication system to communicate with the PCI control card. The communication rate can reach 25 Mbps, ensuring the timeliness of control information and sensor information transmission.

CAN communication / LVDS communication multiplexing circuit

Figure 3 CAN communication / LVDS communication multiplexing circuit

The thumb internal rotation/abduction degree of freedom drive motor is controlled by the custom component PWM in the NIOS core. The component function is written in VHDL language, and the PWM wave period and duty cycle are adjustable. The motor drive chip uses the MPC17531A, which integrates a double H-bridge to directly control the DC brush motor.

2.2 finger motion control module design

The five-finger motion control module uses the same design to enhance system interchangeability and versatility. The module is controlled by DSP as the control core. The DC brushed motor drive chip MPC17531A is used as the motor drive chip. It is responsible for the driving of the finger motor, the acquisition and processing of the torque sensor, position sensor and motor current sensor signal, and the communication with the tactile sensor system. Finally, Each data communicates with the main control chip module through the RS-485 communication interface. The control module is shown in Figure 4.

Finger motion control module functional block diagram

Figure 4 Functional block diagram of the finger motion control module

The DSP TMS320F28027 used in this module has a high running speed and a small package. The internal integrated 16-channel 12-bit A/D converter enables sampling of torque, position, and motor current signals. The serial asynchronous communication interface communicates with the main control chip module through the RS-485 transceiver interface chip. EPWM module can directly control DC brush motor drive chip MPC17531A.

As shown in FIG. 5, the joint torque sensor signal acquisition system includes a torque sensor, a processing amplifier circuit, a filter circuit, and an A/D conversion circuit. The torque sensor is based on the strain principle. The instrumentation amplifier INA337 is used to form a half-bridge circuit to amplify the torque signal and then enter the A/D conversion chip through the RC filter circuit.

Torque sensor signal acquisition system

Figure 5 torque sensor signal acquisition system

As shown in FIG. 6, the joint position sensor signal acquisition system includes a position sensor, a processing amplifier circuit, a filter circuit, and an A/D conversion circuit. Based on the principle of rotary potentiometer, the position sensor uses the integrated operational amplifier MAX9618 to amplify the potentiometer signal and then enter the A/D conversion chip through the RC filter circuit.

Position sensor signal acquisition system

Figure 6 position sensor signal acquisition system

2.3 EMG signal acquisition module design

The EMG signal acquisition module is used to collect the signal of the EMG electrode and the signal filtering and D/A conversion and store it in the CPU, including the filter circuit composed of the RC circuit, the D/A conversion circuit and the voltage conversion circuit. The digital signal is converted to 3.3 V by a voltage conversion chip and input to the CPU central processor via the SPI interface.

2.4 battery management system module design

The battery management module includes a battery, a current sensor, a buzzer circuit, and an LED display circuit. The current sensor monitors the battery output current in real time, and displays the charging status and low battery alarm through the LED display circuit and the buzzer circuit.

TFT LCD Module

How does TFT work?
TFT is the abbreviation of "Thin Film Transistor", generally refers to thin film liquid crystal displays, but actually refers to thin film transistors (matrix)-can "actively" control each independent pixel on the screen, which is The origin of the so-called active matrix TFT (active matrix TFT). So how exactly is the image produced? The basic principle is very simple: the Display Screen is composed of many pixels that can emit light of any color, and the purpose can be achieved by controlling each pixel to display the corresponding color. In TFT LCD, backlight technology is generally used. In order to accurately control the color and brightness of each pixel, it is necessary to install a shutter-like switch after each pixel. When the "blinds" are opened, light can pass through, and " When the shutters are closed, light cannot pass through. Of course, technically, it is not as simple as the one just mentioned. LCD (Liquid Crystal Display) utilizes the characteristics of liquid crystals (liquid when heated, and crystallized into solid when cooled). Generally, liquid crystals have three forms:
Smectic liquid crystal similar to clay
Nematic liquid crystal resembling a fine matchstick
Cholestic liquid crystal
The liquid crystal display uses filaments, and when the external environment changes, its molecular structure will also change, and thus have different physical properties-it can achieve the purpose of letting light through or blocking light-which is just like the blinds just now.
Everyone knows the three primary colors, so each pixel on the display screen needs three similar basic components described above to control the three colors of red, green, and blue respectively.
The most commonly used one is twisted nematic TFT LCD (Twisted Nematic TFT LCD). Existing technologies vary greatly, and we will cover them in detail in the second part of this article.
There are grooves on the upper and lower layers. The grooves on the upper layer are arranged longitudinally and the grooves on the lower layer are arranged horizontally. When no voltage is applied to the liquid crystal in its natural state, the light emitted from the light emitting layer of the twisted nematic TFT Display working principle diagram of Figure 2a will be twisted by 90 degrees after passing through the interlayer, so that it can pass through the lower layer smoothly.
When a voltage is applied between the two layers, an electric field is generated. At this time, the liquid crystals are aligned vertically, so the light will not be twisted-the result is that the light cannot pass through the lower layer.

(2) TFT pixel structure: The color filter is divided into red, green, and blue according to the color, which are arranged on the glass substrate to form a group (dot pitch) corresponding to a pixel. Each monochromatic filter is called It is a sub-pixel. In other words, if a TFT display supports a maximum resolution of 1280×1024, then at least 1280×3×1024 sub-pixels and transistors are required. For a 15-inch TFT display (1024×768), then a pixel is about 0.0188 inches (equivalent to 0.30mm), for an 18.1-inch TFT display (1280×1024), it is 0.011 inches (equivalent to 0.28mm) .
As we all know, pixels are decisive for the display. The smaller each pixel is, the larger the maximum resolution that the display can achieve. However, due to the limitation of the physical characteristics of the transistor, the size of each pixel of the TFT at this stage is basically 0.0117 inches (0.297mm), so for a 15-inch display, the maximum resolution is only 1280×1024.

Tft Lcd Module,Lcd Liquid Crystal Display Module,Lcd Module,Lcd Screen Module

ESEN Optoelectronics Technology Co., Ltd, , https://www.esenoptoelectronics.com