Prototype Design Internet of Things Based Waste Management Using Image Processing

A R T I C L E I N F O A B S T R A C T Article history: Received: 26 January, 2021 Accepted: 08 March, 2021 Online: 20 March, 2021 Waste is currently a serious problem often found in rural areas, rural areas, and even industrial areas. Waste is a side effect of activities carried out by humans to meet social or industrial needs. Increasing human productivity will also increase the amount of waste produced. To overcome this, a sorting management system is needed. Good waste is seen from the processing method to the recycling process. The waste management problem still relies on the old system transporting and disposing of waste to the final disposal site (TPA). The TPA itself sometimes piles up in one place so that the waste process becomes uneven and the sorting process is not good, causing type waste. This accumulates and mixes with other hazardous waste. In today's modern era, the management and sorting system is the same. Object detection and waste classification are carried out in the Sensor system to introduce the previously prepared model. The prototype article recognition model is prepared with waste images to produce a freeze forecast graph used for object discovery which is carried out via the camera associated with the Arduino Uno as the basic unit handling. Ultrasonic sensors are inserted into each garbage compartment to filter out the refill filling rate. The sorting system itself can use computer-based image processing methods. Image Processing is used to process data in real-time and fill the trash level. The sensor module that is implanted to detect waste management personnel, the results of this study prove that image management can accommodate waste particles and tested in the BlackBox method produces results following the required quantitative with the accuracy in both the camera, sensor, and image process used can detect an average of 70%.


Introduction
Currently, waste can be referred to as the effect of activities carried out by urban or rural communities. Waste is a waste product or a used product that is not produced. This residual product has less benefit compared to the product used, so the residual effect is discarded or not reused. Various types of waste are called Solid Waste. Garbage is divided into two types, namely organic waste and non-organic waste. Organic waste is waste that can be broken down, such as food scraps. Leaves, and wood, while non-organic, are waste that cannot be decomposed but can be recycled, such as plastic, glass, paper, and metal waste. This waste will be a disaster for human life and the environment if it is not appropriately managed so that a sorting system and good processing to reduce the effects and side effects for the environment are needed [1,2].
While human waste (human waste) is commonly utilized for stomach-related items, the human can be a genuine wellbeing danger since it can be used as a vector (implies of advancement) for infections caused by infections and microbes. One of the advances in diminishing infection transmission through human squanders with a clean and sterile way of life. A sound sanitation system cannot be separated from the regulation. Some examples of waste generated in households include waste from batteries, electric lights, electronics, pesticide packaging, clothes bleach, floor cleaners, paint, pressure cans (aerosol), fuel packaging, leftover medicines (pharmaceuticals), mercury thermometer, and syringes. The ingredients contained therein have characteristics that can cause harm to human safety and health and environmental pollution [3,4].
Waste management is an excessive activity as it takes up a lot of assets and work. The specialists have endeavored to improve the board frameworks by setting up the recyclable canister and ASTESJ ISSN: 2415-6698 dispatching the 3Rs lobby (recycle, reuse and reduce). At the same time, the problem currently faced is waste disposed of either by home or industry. It is still mixed and has not been correctly sorted. For example, the household waste itself has dangerous substances such as high-pressure aerosol cans, waste liquid, and pharmaceutical drug remnants, this type of waste will become toxic. Some of the items can be flammable, which is dangerous for cleaners and the surrounding environment. Current waste sorting system technology has offered various solutions, including the use of technology-based electronic sensors [5].
Information is a component of the IoT needed in communicating because several main elements must be known in communicating on IoT devices, namely the communicator, listener, and information message. Further processing of data that already has added value or, in other words, information is data that has been classified or processed or interpreted for use in the decision-making process. The communication system used can be a GSM module to transmit data from sensors to the clouds in the form of a web-based [6,7].
There was no tool for sorting waste into certain parts in previous research due to inadequate waste processing factors. This study focuses on processing waste sorting by utilizing computer vision [8,9] and sorting management where data processing is accurate and very suitable for placing on other large machines. It is hoped that this tool can help several dumpsites [10,11].

Related Work
With the uneven development of Internet of Things (IoT) arrangements comes the more major worry over security issues related to most gadgets. It is extended that the product on the Internet of things related gadgets will surpass 20 Billion devices by 2020 [12,13]. A considerable lot of these arrangements will use and using cell association availability to interconnect. An inadequately architected cell network can open the answer for potential security issues. A profoundly gotten compositional understanding requires a multilayered security approach enveloping the by and large building plan for the web, traversing from the edge gadget as far as possible up to the objective host for preparing, stockpiling, and further use. [14][15][16].
For an IoT-based answer to being actualized, it ought to be energy effective, ready to impart and share data across broadened inclusion. An IoT-based installed framework is proposed in [17]. GSM correspondence innovation is utilized as the stage to perform information transmission to the worker. In [18], a keen container framework dependent on AI, picture handling, and IoT is proposed. This framework utilizes a convolutional neural organization (CNN) to distinguish and isolate squander into various classes, like metal, glass, paper, and plastic. A sum of 400 to 500 pictures containing the four unique types is utilized to prepare the organization [19].
The IoT device has a central control system or what is called a microcontroller [20,21]. A microcontroller is a computer system built on a single chip and a processor used for control purposes. Even though it has a much smaller form than a personal computer and the mainframe computer, the microcontroller is built from the same essential elements. One of the microcontrollers often used is the Arduino Uno [22,23]. The system utilizes Raspberry Pi 3 and Xilinx PYNQ-Z1 FPGA board and pre-trained ResNet-34, a convolution neural organization containing 34 pre-trained layers to perform gathering. The data accumulated from the canister is sent utilizing a LoRa correspondence arrange from a sensor center to the section.
Arduino is a microcontroller development board based on Arduino using the Atmega2560 chip. This board is total, has everything required for a microcontroller. With primary usage, the researcher has to connect the control from USB to PC or via a connector. The following is a table of specifications from the Arduino Mega [24,25]. Another sensor that is used to monitor the volume of the trash can is ultrasonic. The working principle of the HCSRF-04 Ultrasonic Sensor is a transmitter that sends an ultrasonic wave which is then measured by the time it takes until the reflection of the object arrives. The length of time is proportional to twice the distance between the sensor and the object [26][27][28]. because there are many types of microcontrollers, the image below is the result of how the microcontroller diagram works. In a waste bin, waste is divided into two parts, namely solid and liquid waste. Liquid waste is a type of waste that is dangerous because it can seep into the ground and will affect air quality, so detection is necessary for the trash. This liquid waste uses a ph Meter sensor. The sensor will deal with the edge of waste and go into protected or dangerous conditions. Next, the pH meter comprises an anode (estimating test) conveyed to an electronic gadget that measures and shows the pH esteem.
The main working principle of a pH meter lies on the sensor probe in the form of a glass electrode by measuring the number of H3O + ions in a solution. The tip of the glass electrode is 0.1 mm thick round glass. By using a layer (bulb), this tool is paired with an elongated non-conducting glass or plastic cylinder, which is then filled with HCl. In the HCl solution, a long silver electrode wire is immersed on the surface that compounds the AgCl balance.
The constant amount of HCl solution in this system makes the Ag / AgCl electrode has a stable potential value. The pH sensor core is on the surface of a glass ball which can exchange positive ions (H +) with a measured solution. The things above that can help in the sorting process into the TPA (final disposal site). With the help of existing sensors. It is also our contribution because, in previous studies, there has not been any research until the landfill [29,30].

Research Methodology
Based on several literature studies, a sorting system can be combined with a hardware device or device, these devices include infrared sensors and metal detection sensors which are commonly used, identification of the types of metal and non-metal waste itself functions to facilitate the sorting process as well as the plastic and paper waste separation system and another method is the use of image processing, this system is beneficial when sorting in visual form, an application that has a reliable level of intelligence is needed in sorting waste types so that the sorting method with image processing techniques and IOT combinations becomes a solution and help choose the type of waste and its characteristics [31,32].
Before creating a sorting system, a grouping of the kinds of waste is needed. It is necessary because the type of waste itself has different effects and characters. It is based on the type and area of waste found. In contrast, the most recent waste is toxic waste and is very dangerous to human health and the environment. Based on this problem, a reliable sorting system is needed. This research has reviewed IoT-based waste processing technology. It can be combined with the sensor to detect the presence or absence of a toxic substance. Toxic substances in the waste are carried out by a sensor sorting the use of image processing technology to detect the categorization of types of waste [33,34]. Figure 2 analyzes the waste image images and sorts them by several stages. First, data collection is carried out. The researcher in this section looks for the pictures needed as a database. Second and third image processing is done into RGB and Grayscale to assist in the image processing process. Fourth, image processing is carried out by looking for patterns from the image. Fifth, the result of the pattern obtained is the recognition of the shape of the image, which will be used for classification at a later stage. The last is to determine the classification to determine whether the image is as desired and looking at the resulting accuracy, the resulting accuracy will explain in the last section. [35]. • Taking Picture In this process, taking pictures can be using a mobile device or a camera mounted on a conveyor machine. The camera is endeavored to have a high image capture capability so that the accuracy of the object taken has a high reading data precision.

• Sharping Picture
In this process, image sharpening reduces accuracy if the object is taken in a low light condition. The image processing algorithm has a high reading accuracy and can sharpen the item to be processed.

• Removing Noise
Removing vandalism or distracting light objects can result in decreased accuracy of per-item readings. In this process, the worrying process will be eliminated by the system. • Image Processing the object reading process is performed by distinguishing the objects read by the system. It can be determining the color of the texture, the shape of the item, the data of each object will be converted into binary numbers. After That stored in the database as training data, the amount of training data using plastic, metal waste samples, cans, and organic.

• Result
In this process, the system will display and classify several types of waste into metal and non-metal waste and classify it into organic and non-organic waste [36,37].

Taking Picture
Sharping Picture

Removing Noise
Image Prosessing

Result
In this method, a sorting system is performed using image processing techniques. This method has reliability in recognizing an object and has been implemented in various fields. This system also has a level of accuracy and can be used to sort waste by type and size. In general, the current sorting system using a conveyor machine is used to sort metal and non-metal waste, which in turn serves to facilitate the process of smelting and recycling. This conveyor system works by reading sensors installed on the sorting machine. Sensors that are often used are usually humidity sensors, heavy sensors, and solenoids to detect metals. This system can detect and classify types of waste but still has the disadvantage of distinguishing types of waste based on the form of waste and the presence or absence of hazardous chemicals in the waste. This must be overcome so that a manual sensor is needed that is combined with imaging techniques and is equipped with image processing. So it can endanger hazardous chemicals in treated waste. Another thing that causes the spread of toxic substances in a waste to be detected. The space of chemicals can be very dangerous and visible, especially in waste-making materials that contain metals.
Sampling data for training is more than 5000 garbage data collected. The amount of data is a data collection standard used to identify types of organic and non-organic waste. The garbage data is then converted into a binary number which represents an assessment of the type and color of the object. After that, it will then be seen visually by the system.  Figure 4 above is the process of image conversion using python and the NumPy library. The script above shows that the captured image will be converted to RGB format for each picture frame. The image is then converted to 100x100 pixels, which is the size set for 255 as the largest size. This method serves to calibrate the image size and the selected object to be determined.
In this study, researchers used a BlackBox to measure the success of the prototype quantitatively. By understanding the black box, the resercher can interpret the model, know the role of each layer, as well understand the stupid side of the model made.

Result
The following is a display of the results of the UI / UX program from the IoT application program for the efficiency of trash cans and the results of implementing an image-based process. Figure 5: Trash bin login system Figure 5 above is a place sorting system that is integrated with mobile devices. In this application, there are additional security features that are used for login validation. It uses an email data recognition system and can manage more than one trash can area. Figure 6: Trash bin login system Figure 6 above shows how the gas sensor works, which will forward the data taken from the sensor installed on the smart trash bin. The sensor sends data via clouds and is displayed from the mobile device in a website application. The sensor data will automatically be monitored by the system and displayed changes every time depending on the amount of waste available.  Figure 7 is the overall data monitoring system. Four components are monitored, namely; • Trash bin status The same place has two monitoring conditions that can be used and are not ready to be used. If it is full, then the trash cannot be used and is in a full state until it exceeds the trash bin's capacity limit.

• The number of contents in the trash bin
The second component is measuring trash bins based on the number of bins with a capacity of up to 180 cm high and then filled with 148 cm. Based on this data, the trash cans are still in use.

• Liquid sensor data
This type of detectable waste has two types of solid and liquid. Waste in liquid form has high toxicity and can damage other waste. This sensor will detect a lot of waste in liquid form, and the system will provide information if the pH meter of liquid waste exceeds normal limits.

• Gas sensor data
The last sensor is a gas sensor. This sensor will detect the presence of waste and hazardous chemicals in the trash. Hazardous chemicals can cause poisoning to fires that can endanger the surrounding environment. The smart trash bin has menu information that can see the condition of the trash that is full. After that, toxic gas is also measured. This sensor is located on the lid of the trash because harmful gases are lighter and more comfortable to detect. The waste sorting system has a function to process images to select two types of waste, organic and non-organic. This system uses a computer vision method where waste data will be recognized and identified according to the type of waste. Make this system, and waste type data must be collected first by dividing the research data into two, namely in the training data mode and data testing.  Figure 8 is an image-based sorting system used as a processing material for the sorting system, as training data for the author to take image data from various sources on the Internet. Direct image taking requires additional lighting and tools because the image processing system itself depends on the camera's reliability.
Data reading and accuracy on the amount of training data and testing data used. The type of algorithm selection is very influential on the pattern recognition method. This method dramatically determines the speed and accuracy of data reading.  Figure 9 is a method for changing the color from the original RGB image to greyscale. This process is needed to identify plastic bottles and glass bottles because the white color in an image processing will be converted to zero (0) and black with a value of one (1). , so that one of the plastic bottle sorting systems apart from the color will also be read. From its shape by using the edge detection method, in this section, the data information from the glass plastic bottle will be taken through the level of additional lighting so that the nuances of the resulting data color become gray or also called by the achromatic method. Figure 10: process of detecting patterns, shapes, edges, and colors Figure 10 is an essential step because an object, in this case, a plastic bottle and glass bottle, will be processed and recognized again by detecting its shape, then clicking the edges to see the type of characteristics of the bottle.  Figure 11 is the final result of the plastic waste detection system. that image the system visually provides information on the type of plastic waste. This case is divided into various kinds of plastic bottle waste and glass bottle waste. The sorting procedure is carried out quickly by the system using image processing algorithms.
To see the results based on the Blackbox, here is a quantitative measurement of the results of this study.   The results according to table 1-3 show that the functionality of the prototype is fairly good because the accuracy in both the camera, sensor, and image process used can detect an average of 70%.

Conclusion
In the experiment, the waste processing process using several technologies by using IoT (Internet of Things) using image processing methods. IoT systems are very suitable for use outdoors and mounted on a sensor. This sensor is straightforward to configure and integrate with the system. Website application, the IoT sensor has the advantage of being able to detect the type of waste in the form of liquids and gases, which functions to detect waste and hazardous substances. In contrast, the image processing method has reliability. Can detect types of waste by recognizing types of waste. Image processing techniques can run in various programming languages and types of platforms. Image processing is fully available in the form of platform libraries in all programming languages . Also, the output system can assign classes to objects, and to use the image processing method can be used to detect the type of metal or non-metallic waste according to the dataset used as needed. The results also show, from the side of the tool, it can detect waste. While the image imaging process where the prototype is capable of with an average accuracy of 70%. For further investigations, it is hoped that it can be checked not only in the form of a prototype but also in the form of a device with a detection result above 90%.